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1.  INTRODUCTION  AND  SUMMARY 


This  Interim  technical  report  describes  research  performed  on  the  distri¬ 
buted  processing  of  sensor  data  for  situation  assessment  in  a  distributed  sensor 
network  (DSN).  This  research  has  been  performed  at  Advanced  Information  & 
Decision  Systems  under  the  contract  entitled  "Distributed  Hypothesis  Testing  in 
Distributed  Sensor  Networks". 


1.1  DSN  PROBLEM  DESCRIPTION 

We  assume  a  system  structure  as  in  Figure  1-1.  There  is  a  system  of  distri¬ 
buted  sensor/processor  nodes.  Each  node  may  have  one  or  more  sensor  types, 
and  the  sensors  from  different  nodes  may  have  overlapping  coverage.  The  sensors 
collect  data  from  the  environment  and  pass  them  on  to  the  processors  (processing 
nodes).  The  processing  nodes  process  the  sensor  data  and  communicate  with 
other  nodes  through  the  communication  network  to  obtain  an  assessment  of  the 
state  of  the  world.  It  is  generally  assumed  that  no  single  node  possesses  complete 
information  and  each  node  may  have  a  different  world  model.  The  processing 
nodes  can  also  control  the  sensors  to  improve  on  the  performance  of  the  overall 
system. 

A  distributed  sensor  network  can  be  used  for  many  applications.  \V<*  nr 
particularly  interested  in  a  DSN  which  is  used  for  the  tracking  and  ciassiilcat’.ou 
of  multiple  targets.  The  target  environment  is  assumed  to  be  dense,  so  that 
determining  the  origins  of  the  measurements  in  a  particular  sensor  report  is  not 
always  e  sy.  The  problem  is  further  complicated  by  the  presence  of  false  alarms 
and  missing  target  reports.  In  such  a  network,  tracking  and  classification  is 
highly  dependent  on  identifying  the  right  data  association  hypotheses  Since  the 
nodes  in  general  have  access  to  different,  information,  communication  among  the 
nodes  can  greatly  improve  the  performance  of  the  system.  The  problem  is  thus 
one  of  distributed  hypothesis  formation  and  evaluation,  which  we  can  abbreviate 
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S  =  SENSOR 
P  =  PROCESSOR 


Figure  1-1:  Distributed  Sensor  Network 
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as  distributed  hypothesis  testing. 

In  our  previous  DSN  project  we  Initiated  research  on  the  distributed  track¬ 
ing  of  multiple  targets  by  the  nodes  of  a  distributed  sensor  network.  In  the  fol¬ 
lowing  we  shall  review  a  model  of  the  processing  node  that  has  been  proposed. 


1.2  PROCESSING  NODE  MODEL 

The  processing  nodes  are  the  main  Information  processing  units  In  the  DSN. 
Each  processing  node  collects  measurements  from  a  set  of  sensors.  Its  function  is 
to  process  the  local  sensor  data  to  form  an  assessment  of  the  state  of  the  world, 
to  combine  the  Information  obtained  from  other  nodes  with  the  local  Information 
to  update  its  assessment,  to  distribute  information  to  other  nodes,  and  to  per¬ 
forms  these  functions  effectively.  These  functions  are  performed  in  four  separate 
modules  within  each  processing  node  (see  Figure  2-2).  In  the  following  we  shall 
discuss  the  modules  in  more  detail. 


1.2.1  Generalized  Tracker /Classifier 

This  module  Is  responsible  for  the  local  data  processing  before  any  com¬ 
munication  with  the  other  nodes  takes  place.  Since  the  objective  of  the  system 
under  consideration  Is  the  tracking  and  classification  of  multiple  targets,  this 
module  is  a  multitarget  tracker.  In  the  previous  project,  we  have  developed  a 
general  theory  for  multitarget  tracking  which  is  implemented  in  the  form  of  the 
Generalized  Tracker/ Classifier  (GTC).  The  GTC  has  the  structure  shown  in 
Figure  2-3  and  itself  consists  of  four  modules.  The  hypothesis  formation  module 
forms  multiple  hypotheses  from  the  sensor  data,  each  consisting  of  a  collection  of 
tracks  to  explain  the  origins  of  the  measurements  in  each  data  set.  These 
hypotheses  are  then  evaluated  by  the  hypothesis  evaluation  module  with  respect 
to  their  probabilities  of  being  true.  The  filtering  and  parameter  estimation 
module  generates  state  estimates  and  classifications  for  each  track.  It  is  essential 
for  hypothesis  evaluation  and  can  thus  be  viewed  as  a  submodule.  To  stay 
within  the  computational  constraints  of  each  node,  the  hypotheses  arc  pruned, 
combined,  clustered,  etc.  'Phis  takes  place  in  the  hypothesis  management  module. 
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Figure  1-3:  Generalized  Tracker/Classifler 
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The  result  of  this  processing  Is  a  set  of  hypotheses  and  their  probabilities,  a  col¬ 
lection  of  tracks  corresponding  to  possible  targets  and  the  state  distributions  of 
these  tracks.  These  quantities  together  constitute  the  information  state  for  mul¬ 
titarget  tracking. 

1.2.2  Information  Fusion 

This  module  combines  the  local  Information  with  information  obtained  from 
the  other  nodes  to  obtain  a  new  situation  assessment.  The  information  from  the 
local  nodes  consists  of  the  information  described  above.  The  information  from 
other  nodes  Is  also  similar.  Information  fusion  then  consists  of  the  following  steps 
(see  Figure  2-4): 

1.  Hypothesis  Formation  -  Given  a  set  of  hypotheses  from  other  nodes,  this 
submodule  generates  new  global  hypotheses.  Tracks  from  the 
hypotheses  of  different  nodes  are  associated  in  all  possible  ways,  whether 
they  correspond  to  the  same  or  different  targets. 

2.  Hypothesis  Evaluation  -  Each  of  the  hypotheses  formed  above  is  then 
evaluated  with  respect  to  Its  probability  of  being  true.  The  statistics  of 
the  tracks  from  different  hypotheses  are  used  in  this  evaluation.  For 
example.  If  two  tracks  are  widely  apart  in  their  position  or  velocity  dis¬ 
tributions.  they  are  more  likely  to  have  come  from  different  targets  than 
the  same  target. 

3.  Hypothesis  Management  -  This  is  again  needed  to  make  computation 
feasible  within  the  available  resources. 


1.2.3  Information  Distribution 

This  module  decides  what  Information  is  to  be  transmitted,  who  gets  the 
information,  and  when  It  should  be  communicated.  It  thus  specifies  the  informa¬ 
tion  available  to  each  node  at  any  time.  i.e..  the  information  structure  of  the 
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Figure  1*4:  Information  fusion 
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system.  Information  distribution  can  be  fixed  a  priori  for  simple  systems,  or  it 
can  be  highly  adaptive  to  the  information  needs  in  the  system. 


1.2.4  Resource  allocation 

This  module  allocates  the  resources  under  the  control  of  the  processing  node 
to  maintain  or  Improve  the  performance  of  the  system.  Some  typical  resources 
Include  sensor  resources  and  processing  resources.  Both  resource  allocation  and 
information  distribution  can  affect  the  information  available  in  the  network. 
Thus  their  activities  should  be  coordinated. 


1.3  PROJECT  GOALS 

Many  technical  issues  have  to  be  addressed  before  DSN's  can  be  designed, 
built  and  operated  to  achieve  their  military  potential.  Such  issues  include  the 
representation  and  processing  of  hypotheses,  information  fusion,  communication 
strategies,  resource  allocation,  adaptation,  system  architecture,  etc.  In  our  previ¬ 
ous  DSN  project,  we  have  successfully  addressed  some  of  these  issues.  The  goal 
of  our  current  effort  Is  to  further  advance  the  state  of  the  art  in  distributed 
hypothesis  testing  techniques  in  DSNs,  This  will  provide  more  insight  as  to  how 
a  DSN  should  be  designed.  Specifically,  we  Intend  to  accomplish  the  following 
technology  goals: 

1.  Deveiop  intelligent  distributed  algorithms  applicable  to  a  wide  range  of 
situations  such  as  different  network  configurations,  sensor  typos,  target 
models,  such  algorithms  should  also  be  adaptive  tc  changing  network 
conditions  and  make  efficient  use  of  sensor  resources. 

1.  Evaluate  and  adapt  these  algorithms  for  real-time  implementation. 

1.  Design  experiments  to  test  and  evaluate  the  algorithms  in  a  more  realis¬ 
tic  scenario  such  :ts  the  Lincoln  Laboratory  test-bed. 

In  companion  to  these  technology  goals,  our  plan  is  to  develop  a  simulation 
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environment  to  test  the  algorithms  experimentally  on  different  scenarios 


1.4  PROJECT  STATUS 

There  are  two  parts  to  our  research  effort.  The  first  consists  of  develop¬ 
ment  of  algorithms  for  a  DSN  and  the  other  is  concerned  with  the  development 
of  a  simulation  environment  to  test  the  algorithms  and  to  evaluate  the  perfor¬ 
mance  of  the  system  experimentally.  In  the  following  we  discuss  their  status 
separately. 


We  have  considered  information  infusion  for  DSNs  with  arbitrary  communi¬ 
cation  patterns  among  the  nodes.  The  key  problems  are  the  formation  of  possi¬ 
ble  (or  meaningful)  global  hypotheses  from  a  group  of  local  hypotheses  and  the 
evaluation  of  their  probabilities.  A  set  of  local  hypotheses  can  be  inconsistent  so 
that  they  cannot  be  fused  to  form  a  global  hypothesis.  The  local  probabilities  of 
the  local  hypotheses  may  depend  on  common  Information  which  needs  to  be 
identified.  In  the  previous  project  we  developed  fusion  algorithms  assuming 
broadcast  communication.  In  the  current  project  we  have  obtained  fusion  algo¬ 
rithms  for  arbitrary  communication.  The  algorithms  are  based  on  modeling  the 
events  In  the  DSN  by  means  of  an  Information  graph.  To  use  these  algorithms, 
the  histories  of  the  hypotheses  and  tracks  have  to  be  part  of  the  Information 
communicated.  Then  each  node  can  determine  the  fusablllty  of  the  hypotheses 
and  tracks  and  the  common  information  which  has  to  be  removed  In  evaluating 
the  hypotheses.  Information  distribution  strategies  have  also  been  considered. 
These  include  strategies  which  depend  only  on  the  local  information  state  and 
those  which  model  the  behavior  of  other  nodes. 

The  theory  of  multitarget  tracking  has  been  extended  to  handle  targets 
with  a  structured  state  space  and  dissimilar  sensors  which  observe  different  com¬ 
ponents  In  the  target,  state.  The  resulting  GTC  for  processing  of  local  sensor 
data  and  the  information  fusion  algorithms  arc  very  similar  to  the  usual  case. 
However,  a  multilevel  hypothesis  formation  and  evaluation  processing  architec¬ 
ture  is  often  possible.  Consider  a  network  with  two  nodes.  Each  node  would 
form  hypotheses  based  on  the  local  measurements  and  the  tracks  would  be 
described  Iti  the  local  feature  space.  During  the  fusion  process,  knowledge  on  th<- 
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relationship  between  the  features  would  be  used  to  generate  higher  level  target, 
tracks  from  the  local  feature  level  tracks.  Hypothesis  evaluation  would  then  be 
carried  out.  As  an  example,  consider  the  tracking  of  vehicles.  Suppose  one  sen¬ 
sor  node  measures  only  the  track/whee!  feature  and  the  location,  feature  tracks 
from  this  node  would  consist  of  wheeled  or  tracked  vehicles  over  time.  Suppose 
another  sensor  node  measures  only  the  location  and  whether  the  vehicle  has  gun 
or  no  gun.  Tracks  generated  would  consist  of  gunned  or  gunless  vehicles  over 
time.  During  fusion,  one  would  use  the  fact  that  a  vehicle  with  a  gun  and  track 
is  a  tank,  a  vehicle  with  neither  gun  nor  track  is  a  truck,  etc. 

In  the  previous  DSN  project,  we  have  concentrated  on  Independent  targets. 
We  have  now  investigated  multitarget  tracking  on  structured  sets  of  targets. 
These  Include  targets  which  move  in  groups.  One  example  would  be  planes  flying 
in  formation.  Another  more  complex  example  consists  of  military  force  struc¬ 
tures.  A  division  would  consist  of  regiments  each  of  which  consists  of  battalions, 
and  so  on.  The  tracking  and  identification  or  such  structured  targets  is  impor¬ 
tant  but  no  much  systematic  treatment  is  available.  The  problem  is  also 
interesting  in  a  distributed  framework  since  the  observations  at  different  nodes 
may  be  at  different  levels  and  targets  are  no  longer  Independent.  We  have 
developed  models  for  structured  sets  or  targets,  and  the  notions  of  multilevel 
tracks  and  hypotheses.  They  are  generalizations  of  our  previous  work  on  multi- 
target  tracking  which  may  be  viewed  as  having  a  single  level  of  targets.  Central¬ 
ized  algorithms  for  evaluating  multilevel  hypotheses  have  been  obtained.  When 
restricted  to  two  levels  with  targets  moving  in  Independent  and  Identically  distri¬ 
buted  groups,  our  results  resemble  those  In  single  level  tracking  except  the  tar¬ 
gets  In  the  level  are  the  groups  themselves.  The  main  difficulty  in  Implementing 
these  algorithms  Is  In  the  combinatorics,  which  becomes  more  severe  with  more 
levels.  Thus  more,  practical  methods  for  hypothesis  evaluation  have  to  be  found. 
Our  future  effort  would  also  include  finding  distributed  versions  or  the  algo¬ 
rithms 


The  other  part  of  our  research  effort  Is  concerned  with  the  development  of 
the  simulation  environment.  Since  an  analytic  evaluation  of  the  algorithms  and 
the  system  performance  is  difficult  our  approach  is  to  perform  simulation  studies. 
We  have  developed  a  simulation  system  consisting  of  four  DSN  nodes  with  com¬ 
munication  patterns  which  can  be  specified  arbitrarily.  Some  limited 
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experimentation  on  this  system  has  been  performed  Our  eventual  goal  for  the 
simulation  environment  Is  that  it  should  allow  rapid  construction  or  scenarios  and 
rapid  development  of  the  DSN  system  design  Itself.  Also,  the  environment 
should  be  flexible  enough  to  handle  various  types  of  processing  within  each  DSN 
node,  including  the  Bayesian  analytic  algorithms  such  as  the  GTC  which  have 
been  developed  thus  far  as  well  as  other  Artificial  Intelligence  (AI)  based  algo¬ 
rithms  which  would  be  developed  for  resource  allocation  and  adaptation. 
Towards  this  goal  of  Improving  our  simulation  testbed,  we  have  chosen  an  AI 
architecture,  called  Schemer  as  the  basis  or  the  environment.  The  basic  Idea 
behind  Schemer  is  to  provide  a  computational  environment  In  which  a  system 
designer  can  incrementally  build  his  application  by  specifying  the  components  of 
the  system  Including  the  representation  of  objects  that  must  be  known  to  the  sys¬ 
tem  and  the  procedural  rules  that  define  the  system's  capabilities.  To  provide 
this  representation  support,  Schemer  Is  equipped  with  a  general  frame  representa¬ 
tion  language  for  expressing  such  knowledge.  The  Implementation  of  this 
language  is  currently  in  progress. 

We  have  Investigated  the  representation  of  the  DSN  node  within  the  simu¬ 
lation.  Various  types  of  knowledge,  such  as  static  knowledge,  situational 
knowledge,  planning  knowledge,  and  control  knowledge  have  to  be  represented. 
Since  the  representation  of  the  node  In  the  simulation  Is  a  model  of  the  DSN 
node,  we  have  also  obtained  a  candidate  architecture  of  the  node  In  the  actual 
system.  The  architecture  would  be  able  to  carry  out  both  analytic  and  AI  based 
processing. 


1.5  REPORT  ORGANIZATION 

The  rest  of  this  report  is  organized  as  follows.  In  Section  2,  we  present 
Information  fusion  algorithms  assuming  arbitrary  communication  among  the 
nodes.  The  algorithms  are  based  on  an  information  graph  model  of  the  DSN. 
Section  3  contains  results  on  tracking  or  structured  targets.  Both  targets  with 
structured  states  and  structured  sets  of  targets  are  considered  with  the  emphasis 
on  the  latter  type.  In  Section  \  we  describe  the  design  and  simulation  environ¬ 
ment.  The  representation  of  knowledge  in  the  system  and  Its  architecture  are 
discussed.  Section  5  presents  some  simulation  results  with  our  current  system. 
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An  appendix  contains  the  proofs  of  the  results  in  Section  2. 
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2.  INFORMATION  FUSION  FOR  ARBITRARY  COMMUNICATION 


In  this  section  we  present  algorithms  used  by  each  node  to  fuse  the  infor¬ 
mation  received  from  the  other  nodes  with  the  local  Information  to  obtain  an 
updated  situation  assessment.  In  [l]  fusion  algorithms  for  a  broadcast  communi¬ 
cation  pattern  were  presented.  The  results  of  this  section  extend  those  algo¬ 
rithms  to  arbltray  communication  patterns.  In  Section  2.1  we  describe  the  infor¬ 
mation  fusion  problem  in  the  context  of  hypothesis  formation  and  evaluation  in 
multitarget  tracking.  In  Section  2.2  a  model  for  information  fusion  in  terms  of 
an  information  graph  is  given.  Section  2.3  describes  the  hypothesis  formation 
and  evaluation  algorithms  assuming  arbitrary  communication. 


2.1  THE  INFORMATION  FUSION  PROBLEM 

In  the  following  we  state  the  Information  fusion  problem  faced  by  each 
node  in  the  DSN  with  emphasis  on  the  relevant  issues  In  multitarget  tracking. 
The  formalism  Is  based  on  the  theory  of  multitarget  tracking  developed  in  the 
previous  DSN  project  [1]  and  [2]. 


2.1.1  Local  processing 

The  basic  unit  of  information  in  the  DSN  Is  a  sensor  report  z(t  ,s  ).  This  is 
the  output  of  a  sensor  s  at  a  time  t  and  is  denoted  as 

((!/,(<.»  ))j  \n„  (t  ,s  ),t  ,s  ).  The  index  k=(t,s)  identifies  the  sensor  report  (by 

time  and  sensor)  uniquely  and  Is  called  the  sensor  report  index  or  data  index. 
Nm(k)  is  the  number  of  measurements  in  the  report  and  {y}{k  ))"~\k  ’  is  the  actual 
measurement  vector.  At  any  given  time,  let  Z  be  the  data  set  consisting  or  a  set 
of  sensor  reports  and  A'  be  the  associated  data  index  set,  l.e,  the  set  of  the  indices 
for  all  the  sensor  reports  contained  In  Z .  The  measurement  index  set  correspond¬ 
ing  to  Z  Is  defined  as 
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(2.1) 


J  =  U  {I . NM(k)}x{k}. 

k£K 

Each  element  (;  ,k)—(j ,t  ,a)  In  this  set  represents  the  J-th  measurement  gen¬ 
erated  at  time  t  by  sensor  a.  The  specific  value  of  the  measurement  Is  y3  (t  ,s ). 
According  to  the  system  model  Introduced  In  Section  1,  each  node  processes  the 
sensor  data  as  they  arrive  using  the  Generalized  Tracker/ Classifier  (GTC).  The 
output  of  the  GTC  when  the  data  Is  Z  consists  of  the  information  state  X(Z) 
defined  as 

'J(Z)  =  (T (J).(Pt(x  |  r.Z^jy  H(J).  (P( A-X  |  Z)\eH{J).  «K)) 


where 


•  T(J),  the  set  of  possible  tracks  defined  on  J .  Each  track  r  Is  a  subset  of 
J ,  l.e.,  rC  J  and  represents  the  measurement  indices  coming  from  a  single 
target.  It  Is  usually  assumed  that  a  track  cannot  have  two  measurement 
Indices  In  the  same  sensor  report,  or  the  sensor  resolution  Is  such  that 
there  are  no  spilt  measurements.  Such  tracks  are  then  said  to  be  possi¬ 
ble. 

•  pt(z  |  r,Z )  Is  the  state  distribution  for  a  track.  Given  the  track  r,  the  set 
of  measurements  In  Z  for  a  hypothesized  target  Is  known.  From  this  the 
distribution  of  Its  state  z  (position,  velocity,  classification,  etc.)  at  a  time 
t  can  be  found  and  Is  a  traditional  estimation  problem.  Normally  this 
would  be  given  In  terms  of  a  probability  distribution;  but  If  the  state  can 
be  approximated  by  a  Gaussian  random  vector,  the  distribution  can  be 
expressed  In  terms  of  Its  mean  and  covariance. 

•  H(J)  Is  the  set  or  possible  data-to-data  association  hypotheses  defined  on 
J.  Each  data-to-data  association  hypothesis  X  is  a  possible  explanation 
about  the  origins  of  all  the  measurements  in  Z .  Each  hypothesis  consists 

of  a  set  of  tracks,  l.e.,  X  =  {r,.r2 . }.  The  number  of  tracks  In  X  Is  the 

number  of  targets  hypothesized  to  have  been  detected  In  the  data  set  Z . 
Each  track  r  Is  the  set  of  measurement  Indices  from  a  hypothesized  target 
and  any  measurement  Index  not  Included  In  the  hypothesis  Is 
hypothesized  to  be  a  false  alarm.  We  assume  that  the  sensor  resolution  Is 
such  that  there  are  no  merged  measurements  and  thus  there  are  no 
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overlapping  tracks  In  the  same  hypothesis.  The  set  of  hypotheses  satisfy¬ 
ing  this  property  is  said  to  be  possible.  This  represents  all  mutually 
exclusive  and  collectively  exhaustive  explanations  about  the  origins  of  the 
measurements  in  Z. 

•  P (A=X  |  Z)  is  the  probability  of  that  the  true  data  association  A  is  a 
hypothesis  X  given  all  the  measurements  in  Z .  Its  computation  is  the  key 
operation  in  any  multiple  hypothesis  approach  to  multitarget  tracking 
and  recursive  algorithms  were  given  in  [l]  and  [2]. 

•  v{K )  is  the  expected  number  of  undetected  targets  up  to  and  including 
K .  It  is  important  for  initiating  new  tracks.  If  1A.K)  decreases,  the  likeli¬ 
hood  of  any  measurement  coming  from  a  previously  undetected  target 
also  decreases. 


The  information  state  defined  above  constitutes  a  state  for  multitarget 
tracking  since  it  contains  all  the  relevant  information  present  in  the  cumulative 
data  set  Z.  As  long  as  the  information  state  is  known,  the  GTC  can  con¬ 
tinue  to  process  any  new  sensor  report  even  though  the  actual  data  Z  is  no 
longer  available.  In  the  GTC,  the  hypothesis  formation  module  generates  the 
sets  T (J)  and  H(J)  while  the  hypothesis  evaluation  module  computes  the  remain¬ 
ing  components  In  the  Information  state.  The  hypothesis  management  module  is 
used  to  control  the  combinatorics. 


2.1.2  Information  Fusion  Problem 

We  assume  that  each  node  communicates  the  Information  state  to  the  other 
nodes.  Suppose  a  node  receives  some  messages  from  the  other  nodes.  It  has  to 
fuse  or  Integrate  this  information  with  the  local  Information  to  improve  on  the 
local  estimate.  There  are  many  ways  of  performing  fusion.  In  our  work  fusion  is 
based  on  the  following  philosophy.  The  ideal  case  with  the  highest  performance 
(but  also  the  highest  communication  cost)  is  when  the  nodes  communicate  the 
actual  sensor  data  through  the  network  Instead  of  the  processes  information.  In 
this  case  a  node  would  be  able  to  generate  an  optimal  information  state  based  on 
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all  the  data  available.  Since  In  a  more  realistic  DSN  only  the  Information  states 
are  communicated,  an  appropriate  objective  for  fusion  Is  to  reconstruct  the 
optimal  Information  state  based  on  the  Information  states  received  from  the  other 
nodes.  To  facilitate  further  discussion,  we  call  the  data  available  to  each  node 
before  communication  takes  place  as  local  data  and  the  maximum  data  set  avail¬ 
able  after  communication  as  global  data.  Local  and  global  Information  states, 
hypotheses,  tracks,  etc.  are  all  defined  analogously. 

There  are  thus  two  steps  to  the  fusion  process.  The  first  step  in  the  fusion 
process  consists  of  generating  the  possible  track  and  hypothesis  sets  based  on  the 
global  data  from  the  local  tracks  and  hypotheses.  Since  the  local  data  are  the 
part  of  the  global  data  available  to  the  nodes  at  the  given  times,  the  global 
tracks  and  hypotheses  when  restricted  to  the  local  data  should  give  the  local 
tracks  and  hypotheses.  This  Implies  that  a  certain  combination  of  local  tracks 
and  hypotheses  should  not  be  fused,  l.e.,  there  may  not  exist  global  tracks  and 
hypotheses  for  given  sets  of  local  tracks  and  hypotheses.  In  Figure  2-1,  the  two 
tracks  r,  and  t.,  are  two  local  tracks  maintained  at  two  different  nodes.  They 
cannot  be  fused  since  the  resulting  global  track  would  have  two  different  meas¬ 
urements  In  the  same  sensor  report  1,  thus  violating  the  no  split  measurement 
assumption.  On  the  other  hand,  r,  and  r3  can  be  fused  to  yield  a  global  track 
f|Ur2.  The  Interpretation  of  this  global  track  Is  that  the  measurements  in  both 
tracks  r,  and  r3  come  from  the  same  target.  Tracks  r,  and  ta  can  also  be  fused. 
However,  they  do  not  have  to  be  and  In  that  case  the  two  tracks  correspond  to 
two  different  targets.  The  fusabllity  question  also  needs  to  be  addressed  at  the 
hypothesis  level.  Each  local  hypothesis  Is  a  possible  explanation  about  the  origins 
of  the  local  measurements.  Thus  If  the  local  hypotheses  are  Incompatible,  they 
cannot  be  fused  to  obtain  a  global  hypothesis.  This  is  Illustrated  In  Figure  2-2 
where  each  node  »  has  two  local  hypotheses  \,J,  j  =  1,2  derived  from  the  two  com¬ 
mon  hypotheses  \’,j  =  1,2.  Since  X'  and  X2  are  mutually  exclusive,  the  local 
hypotheses  X,2  and  X2‘  are  not  fusable. 

The  second  step  In  the  fusion  process  consists  In  generating  the  state  distri¬ 
butions  of  the  global  tracks  and  the  probabilities  of  the  global  hypotheses  using 
the  local  distributions  and  probabilities.  If  the  nodes  communicated  in  the  past, 
the  local  statistics  would  not  be  Independent.  A  key  problem  In  fusion  Is  to  Iden¬ 
tify  the  common  Information  shared  by  the  nodes  and  make  sure  It  Is  not  used 
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Figure  2-1:  FusablUty  of  tracks 


Figure  2-2:  Fusabillty  of  hypotheses 


more  than  once  In  generating  the  global  statistics. 


2.2  INFORMATION  GRAPH 

In  performing  Information  fusion,  It  Is  necessary  to  identify  the  Information 
available  to  the  nodes  In  the  network  at  various  times  and  how  the  information 
of  one  node  at  one  time  Is  related  to  that  of  another  node  at  a  different  time. 
For  example,  whenever  two  nodes  communicate  some  common  information  is 
shared  between  the  nodes.  The  existence  of  this  shared  Information  would  have 
to  be  recognized  In  any  future  Information  fusion.  Specifically,  before  any  global 
hypothesis  can  be  generated,  the  fusability  of  the  local  hypotheses  have  to  be 
checked  based  on  their  histories.  Furthermore,  when  the  probabilities  of  the 
hypotheses  are  to  be  evaluated,  the  common  information  should  only  be  used 
once.  This  necessitates  tracking  the  histories  of  the  communication  and  can  be 
accomplished  conveniently  using  the  Information  graph.  The  information  graph 
Introduced  below  can  also  be  viewed  as  an  abstract  model  for  a  DSN. 


2.2.1  Information  graph  model 

We  assume  that  there  Is  a  set  of  processing  nodes  called  N.  Each  node  n  In 
N  receives  data  from  a  set  of  sensors  called  Sn  such  that  S„  D5,„'=0  for  nj^n', 
l.e.,  each  sensor  a  only  reports  to  one  processing  node.  Let  S=  U  Sn  be  the  set 

ngN 

of  all  sensors.  If  a  sensor  «  generates  a  report  at  time  1  with  value  z ,  the  report 
Is  denoted  as  (z,<,«)  or  simply  z  (<,«).  Each  sensor  report  is  the  basic  unit  of 
information  and  the  set  of  all  such  reports  Is  denoted  by  Z  called  the  total  infor¬ 
mation  or  data  set.  Each  sensor  report  Is  Indexed  by  k  =(t  ,s ),  l.e.,  the  time  t 
when  It  Is  generated  and  the  sensor  s  responsible  for  Its  generation.  The  set  of 
all  such  Indices  Is  called  the  total  data  index  set  and  denoted  as 

K={(t  ,3  )  j  (z  ,t  ,s  )€Z  for  aome  z}  (2.2) 

At  any  one  time,  a  node’s  Information  may  consist  of  only  a  subset  Z  of  Z.  Such 
a  Z  Is  called  a  partial  information  set  or  partial  data  set,  or  simply  information 
set  or  data  set.  For  each  Z  there  Is  a  A  correpondlng  to  the  data  indices  In  Z . 
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The  sensors  send  the  data  lntantaneously  to  the  nodes  as  soon  as  they  are 
generated.  The  communication  among  the  nodes  can  be  characterized  by  the 
communication  schedule  C  which  Is  a  subset  of  TxTxNxN.  An  element 
(f.f'.n.n')  means  that  the  communication  transmitted  at  time  t  by  node  n  Is 
received  at  time  t '  by  node  n 

The  Information  at  each  sensor  or  node  In  the  DSN  Is  affected  by  four  types 
of  events.  The  nature  of  the  events,  the  times  at  which  they  occur  and  the  nodes 
affected  are  given  below: 

1.  Sensor  observation  and  transmission  —  1ST  =  K  X  {ST} 

2.  Sensor  data  received  at  node  --  I SR  =  K  X  {SR} 

3.  Transmission  of  communication  by  node  — 

I ct  =  {(n  ,t  ,CT)  |  {t  ,t\n  ,n')€C} 

4.  Reception  of  communication  by  node  — 
left  =  {{n.t,CR)i(t\t,n\n)eC} 

Let  I  be  defined  as 


I  =  isr  (j  iSR  u  icr  U  left  (2-3) 

I  constitutes  all  the  significant  events  In  the  network  and  forms  the  set  of  infor¬ 
mation  nodes  (not  DSN  nodes)  In  the  Information  graph.  To  represent  the  rela¬ 
tion  between  these  nodes,  we  define  an  antisymmetric,  reflexive  and  transitive 
binary  relation  <  on  I  as  follows:  for  any  i  and  »'  in  I,  »  <«'  if  « =  i'  or  there  Is  a 
communication  path  from  «  to  i'.  The  information  graph  on  the  system  Is  then 
the  ordered  set  (I,<).  By  using  the  graph  we  can  determine  how  the  Information 
In  the  system  flows.  In  particular.  It  Is  easy  to  find  the  history  of  the  information 
at  a  certain  node.  As  we  shall  see  later,  this  is  useful  for  the  purpose  of  Informa¬ 
tion  fusion. 

Figure  2-3  show  the  Information  graph  for  broadcast  communication.  At  a 
given  time  all  the  nodes  communicate  to  each  another  so  that  they  all  have  the 
same  Information  after  that.  Figure  2-4  shows  the  Information  graph  for  a  cyclic 
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■  Sensor  Observation  •  Communication  Transmission 

□  Sensor  Data  Reception  O  Communication  Reception 


Figure  2-3:  Broadcast  communication 


A 
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communication  system.  The  system  consists  of  three  nodes  N— {1.2.3}  collecting 

data  from  the  three  sensors  S={l.2,3},  respectively  at  the  times  ...,tST  <lsr  +td . 

The  nodes  transmit  to  the  other  nodes  periodically  according  to  the  pattern 
shown  In  Figure  2-4  at  times  ...,tCT  ,tCT  +td ...  and  the  messages  are  received  at 
the  times  ....tCR  .ten  +*<*••••  It  is  assumed  that  tST  <tCT  <tCn  • 

For  each  Information  node  «  in  the  information  graph,  the  maximum 
amount  of  information  available  is  the  sensor  data  that  would  be  received  If  they 
had  been  communicated  In  the  network.  Thus  associated  with  each  node  «  the 
(maximum)  data  index  set  A,  and  the  (maximum)  information  set  Z,  are  defined 
as  follows: 

A, =  {k£K\(k.ST)<i}  (2.4) 

Z,  =  {(z.k)£Z\keK,}.  (2.5) 

As  stated  before,  our  philosophy  Is  to  assume  that  each  node  tries  to  reconstruct 
the  best  estimate  as  if  all  sensor  data  are  transmitted.  Thus  from  now  on  the 
Information  available  at  each  node  t  is  assumed  to  be  Z,  with  the  data  index  set 


The  following  observations  are  quite  obvious  from  the  definitions: 

1.  A,  =  {*  eK  |  (Jfc  ,SR  )<« }  for  all  »  in  I. 

2.  A,  C  At.  If  »  < i '.  (The  information  of  a  node  always  Includes  that  of 
any  predecessor  node.) 


3.  A,  =  U  A,'  for  all  i  In  I.  (The  Information  at  a  node  Is  the  union  of 

I  '<1 

that  of  the  predecessors.) 

4.  A,  =  U  A,,  for  all  i  In  I,  where  * '|— ►*  means  that  «'  Is  the  Immediate 
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predecessor  of  i.  (One  needs  only  to  consider  the  Immediate  predeces¬ 
sors  of  «  In  generating  the  information  available  to  i.) 


Since  there  is  a  one-to-one  correspondence  between  K  and  Z,  a  similar  set 
of  observations  can  be  made  for  Z . 

1.  Z,  =  {Z£Z  |  (Z,SR  )<«' }  for  all  «  in  I. 

2.  Z,  CZ,.  if  «  <*'. 

3.  Z,  =  U  Z,<  for  all  «  in  I. 

» '  <  i 

4.  Z,  =  U  Zt.  for  all  «'  in  I. 


Consider  an  information  node  i0€Icr-  This  represents  the  event  that  com¬ 
munication  from  other  nodes  is  received.  Let  /  be  the  set  of  immediate  predeces¬ 
sor  nodes  for  «0.  The  fusion  problem  Is  to  find  the  Information  state  of  »0  using 
the  information  states  of  the  nodes  in  /  (and  those  of  other  predecessor  nodes  of 
/,  if  necessary).  As  mentioned  before,  it  is  important  to  identify  the  common 
information  in  the  data  represented  by  /.  This  turns  out  to  be 


U  Kr 

i'ecd) 


(2.6) 


where 


C(I)={i'£l  |  «'<*  for  all  x£l}  (2.7) 

Is  the  set  of  common  predecessors  for  all  the  nodes  In  I .  Equation  (2.6)  states 
that  the  common  Information  shared  by  the  nodes  In  I  Is  the  union  of  the  infor¬ 
mation  of  the  common  predecessor  nodes  of  /.  In  fact,  based  on  the  observation 
(4)  above.  C(I )  can  be  replaced  by  Cmax(/)  which  Is  the  maximum  set  in  C(7) 
with  respect  to  the  set-inclusion  partial  order  whereby  /,</2  when  /,C/2  and 
»,<«2  for  all  «,€/|  and  »2€/2.  Then  the  union  needs  to  be  taken  only  over  the  set 
„(/),  l.e.,  equation  (2.6)  becomes 


-  U 


(2.8) 


If  necessary,  we  can  regard  Cmnx(I)  as  /  In  equation  (2.8)  and  repeat  the  process 
to  find  the  common  Information  shared  by  all  the  nodes  In  Cn)ax(/).  This  would 
be  used  In  the  following  section  to  develop  distributed  estimation  algorithms. 


2.2.2  Distributed  estimation 


We  now  consider  the  distributed  estimation  problem  to  Illustrate  the  use  of 
the  Information  graph.  Any  uncertainty  In  the  origins  of  the  measurements  is 
Ignored  for  the  time  being.  The  results  would  be  useful  In  the  next  subsection 
when  we  consider  distributed  multitarget  tracking. 

The  state  to  be  estimated  Is  a  random  vector  x .  The  a  priori  probability 
density  (or  distribution)  Is  p( x).  The  observation  generated  by  a  sensor  s  at 
time  t  is  z(t  .a  ).  The  following  additional  assumptions  are  needed: 

•  Both  the  sensor  schedule  K  and  the  communication  schedule  C  are 
Independent  of  the  state  x . 

•  Given  x  and  K,  each  element  In  Z  is  conditionally  Independent  from  each 
other  and  has  an  absolutely  continuous  transitional  probability  from  state 
x  to  measurement. 

The  distributed  estimation  problem  is  then  to  compute  p(x  \  Z,)  for  each  «£l. 
From  the  definition  of  I ,  this  needs  only  to  be  carried  out  for  the  sets  lSR  and 
lCR  since  the  only  activities  at  the  other  nodes  involve  transmission.  For  an 
Information  node  in  lSR ,  we  have  a  traditional  Bayesian  update  problem  where 
the  conditional  probability  is  updated  using  the  sensor  report.  We  are  primarily 
Interested  In  a  problem  Involving  information  nodes  in  lCR .  Suppose  the  Infor¬ 
mation  node  of  interest  is  i0  and  that  the  Immediate  predecessors  of  i0  form  the 
set  /.  Then 


Z,=UZ,  (2.9) 

The  objective  Is  the  computation  of  p  (x  |  (J  Z, )  In  terms  of  the  predecessor  pro- 

•  €/ 

babllitles  p(x  |  Z,-. ),•«<,-.  Ideally,  one  would  like  to  use  only  the  probabilities 
defined  on  /.  but  as  we  shall  see,  this  Is  not  always  possible. 

In  the  appendix,  we  show  that 

p(x  i  u  Zi)  —  r  n  (  n  p(i  i  n  z  )y 1  (2.10) 

I' “I  N,”  ye/v 
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where  c  is  a  normalization  constant  and 


N,n=  {A'C{l....n}|  #(N)=i} 


(2.11) 


is  the  set  of  all  subsets  of  {l,..,n}  with  i  elements.  In  equation  (2.11),  #(/V) 
denotes  the  number  of  elements  In  the  set  N.  For  n  =2,  this  yields  the  fusion 
formula  for  two  nodes: 


p(x  |  Z,(JZ2)=c 


P( x  |  Z ,)p (x  |  Z.,) 

p(x  i  z,nza) 


(2.12) 


Equation  (2.11)  can  be  Interpreted  as  follows.  Since  the  probabilities  p(x  |  Z,) 
and  p[x  j  Z.j)  both  utilize  the  Information  contained  in  Z,DZ2,  the  division  by 
p(z  |  Z,nZ2)  Is  needed  to  remove  the  common  Information  so  that  it  is  used  only 
once.  Equation  (2.10)  is  Just  a  general  form  where  the  probabilities  from  multiple 
nodes  are  to  be  fused.  Unfortunately,  in  both  (2.10)  and  (2.12)  there  are  still 
terms  Involving  intersections  of  the  Z,  's.  If  all  these  Intersections  are  of  the  form 
Z ’•  for  some  Information  node  j  or  empty  corresponding  to  the  common  a  priori 
information,  then  equation  (2.10)  or  (2.12)  serves  as  a  fusion  algorithm.  In  this 
algorithm,  the  conditional  probability  at  the  fusion  node  is  a  product  and  ratio  of 
the  conditional  probabilities  defined  on  a  set  of  predecessor  nodes.  From  the 
definition  of  the  Information  graph,  all  these  probabilities  can  be  communicated. 


If  there  is  an  intersection  (~1  Z,  which  is  not  equal  to  Z,.  for  some  j'£l, 

ieN  3  3 

then  by  (2.6)  the  Intersection  can  be  expressed  as  the  union  of  the  Information  of 

some  information  nodes  again.  Equation  (2.10)  can  then  be  applied  to  evaluate 

the  probability  p(i  I  f|  Z, ).  The  process  can  be  repeated  until  all  the  probabili- 
;t/v  ; 

ties  are  either  conditioned  on  the  information  at  the  individual  information  nodes 
or  the  a  priori  information.  For  notatlonal  convenience,  we  represent  the  a  priori 
Information  by  adding  an  element  i9  to  the  set  I  of  all  the  Information  nodes  and 
let  I=IU {*#}•  Then  the  extended  information  graph  (T,<)  is  constructed  by  let¬ 
ting  ij  be  the  Immediate  predecessor  of  all  the  minimum  nodes  In  the  original 
Information  graph  (I.<).  Then  we  have  Z,-  ■— A',-  0.  With  this  definition  it  can 
be  shown  in  the  appendix  that 

P(x  J  UZ,  )  -  C  II  p (x  J  Zr)",r'  (2.13) 

it/  fc  T 

where  /</  Is  a  subset  of  I,  (n(»))j-f^  Is  some  index  tuple  such  that  r>( i)  Is  a 
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nonzero  integer  Tor  each  «,  and  C  Is  the  normalizing  constant  The  se(  /  con¬ 
tains  all  the  information  nodes  which  are  relevant  to  fusion  at  node  «(i) 
decides  whether  the  information  at  node  i  should  be  added  (»(»')—  l)  or  removed 
(<*(«)=  0- 

To  illustrate  the  use  of  this  algorithm,  let  us  first  consider  a  broadcast  com¬ 
munication  pattern  of  Figure  2-3.  For  notatlonal  simplicity,  we  would  suppress 
the  type  of  the  node  in  naming  the  node.  Consider  the  information  node  (ta(  ,n  ). 
We  have 


n  Z(tcT  ,n  )—Z(tCR  —  td  ,n  ).  (2.14) 

n  6N 

Thus,  the  fusion  algorithm  for  a  node  n  at  time  tCR  is 

_  p  (x  I  Z  (trT  ,* )) 

p(x  \Z(tcn.n))  =  CU— — r—  — —p(r|Z(<™  ld,n ))  (2.15) 

•eN  p(x  |  Z(tat  -  td,t )) 

where  C  is  a  normalizing  constant.  Each  term  In  the  product  is  the  new  infor¬ 
mation  contained  in  the  sensor  report  z(tST,i). 

For  the  cyclic  communication  system  shown  In  Figure  2-4,  consider  node  1 
at  time  tCR .  The  Immediate  predecessors  of  the  Information  node  (fCR,i)  are 
(tcr,l)  and  {tCT ,  2).  Equation  (2.12)  can  thus  be  used  to  find  p(x  \Z(tCK,i)). 
From  the  Information  graph  of  Figure  2-4,  the  common  predecessors  of  ( tCT  ,i ) 
and  (tCT  ,2)  consist  of  the  two  nodes  (tCT  2td  ,l)  and  (tCT  td, 2).  Thus 

Z  (t('T  <l)C)  Z  (tpT  ,2)  —  Z  (tcT  2fj,l)U  Z  (t(;f  td  ,  2).  (2.16) 

and  equation  (2.12)  can  be  used  to  find  the  probability  of  the  right  hand  side 
again.  From  the  Information  graph, 

Z(tcT  '  -1)0  Z(tcT  *2)  =  Z{t(jT  3ld  ,l)U  Z  (IfT  >2)  (2.17) 

=  Z{tcn  31^,1). 

Thus,  the  algorithm  gives  for  general  » =1.2,3 

,  ,  ,,,  „  p(x  \  Z(trT.t))  p(x  |  Z(<rr,|«  +  1])) 

p  (x  Z  {ten  ,« )  --  C - ; - - - 

p(x\Z(trT  2td.i ))  p(x  |  Z(trr  td.\t  (I])) 


Xp(x  |  Z(tn{  Md,i )) 


(2.18) 


where  |i]  Is  «  modulo  3. 


This  Is  In  the  form  of  equation  (2.13)  with  five  nodes  In  the  set  T.  Thus,  In 
addition  to  its  current  conditional  probability  p{x  j  Z(tCT,  1)),  and  p(x  |  Z(tCT  ,2)) 
which  comes  from  node  2,  node  1  has  to  store  three  other  probabilities.  Note 
that  p(x  |  Z(tCT  td,2))  Is  available  to  node  1  from  earlier  communications.  This 
Indicates  that  In  a  distributed  sensor  network,  knowing  the  most  recent  estimate 
may  not  be  sufficient  If  one  wants  to  recover  the  globally  optimal  estimate. 

Our  discussion  above  assumes  the  fusion  algorithm  for  each  node  Is  pro¬ 
vided  by  a  system  designer  based  on  the  Information  graph.  Alternatively,  we 
may  assume  that  the  Information  graph  Is  known  to  all  the  DSN  processing  nodes 
who  then  compute  the  algorithms  In  a  distributed  manner.  Still  another  possibil¬ 
ity  Is  for  each  message  to  contain  a  history  of  the  nodes  and  times  that  It  has 
passed  through.  Then  a  fusion  node  can  use  the  histories  of  the  messages 
received  to  construct  a  partial  information  graph  so  that  fusion  can  be  per¬ 
formed.  This  philosophy  would  be  useful  for  fusion  when  the  communication 
pattern  Is  not  fixed  a  priori,  such  as  when  nodes  can  vary  their  communlatlon 
strategies  or  have  to  adapt  to  system  failures. 


2.3  FUSION  IN  MULTITARGET  TRACKING 

In  this  section  we  consider  the  fusion  algorithm  for  multitarget  tracking 
assuming  arbltary  communication  pattern.  The  algorithm  is  based  on  the  theory 
of  multitarget  tracking  developed  under  the  previous  project  [1]  and  the  concept 
of  the  Information  graph.  In  the  previous  project  [l],  the  Information  fusion  In 
multitarget  tracking  was  Investigated  primarily  for  broadcast  type  communica¬ 
tion  pattern.  In  this  section,  we  treat  the  same  subject  assuming  an  arbitrary 
communication  pattern  which  Is  defined  In  terms  of  an  information  graph. 
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2.3.1  Problem  formulation 


In  Section  2.1  we  introduced  the  fusion  problem  In  general  terms.  We  now 
state  it  more  formally  in  terms  of  an  Information  graph.  Given  the  communica¬ 
tion  pattern  of  the  network,  an  Information  graph  is  defined.  For  each  informa¬ 
tion  node  i  in  the  graph,  there  Is  a  data  index  set  K,  and  an  information  set  or 
data  set  Zx  as  defined  before.  Since  we  are  now  Interested  in  multitarget  track¬ 
ing,  we  have  to  deal  with  measurement  Index  sets  on  which  tracks  and 
hypotheses  are  defined.  A  measurement  index  set  J,  at  an  Information  node  i  is 
defined  as 

Ji  =  {(j.k  )€J  |  k^Ki}. 

The  activities  In  a  DSN  can  be  represented  by  the  expansion  of  the  nodes  in  the 
information  graph.  Two  types  of  nodes,  namely  those  in  Isr  and  Ir7- ,  Involve 
only  communication.  For  the  other  two  types,  namely  the  ones  in  and  lc/{ , 
information  processing  is  Involved.  At  a  node  in  lSR  ,  the  data  received  from  the 
local  sensors  are  processed  by  each  node  using  the  GTC,  producing  an  informa¬ 
tion  state  for  the  node.  For  a  node  »,,G Ic« .  messages  are  received  from  other 
nodes  In  the  DSN  and  fusion  takes  place.  Let  /  be  the  set  of  Immediate  prede¬ 
cessor  nodes  of  i0.  For  any  node  «'  in  /,  assume  the  possible  tracks  T(  Jt )  and  the 
possible  hypotheses  H ( J, )  are  known.  In  addition  to  these,  the  local  probabilities 
of  the  tracks  and  hypotheses  are  also  given.  From  the  information  graph,  the 

measurement  index  set  for  the  information  node  i0  is  J  —  The  two  specific 

■  e/ 

subproblems  in  Information  fusion  are  then  the  following: 

•  (Hypothesis  formation)  How  should  node  t0  construct  the  possible  (global) 
track  set  T(J)  and  the  possible  (global)  hypothesis  set  H(J)  ? 

•  (Hypothesis  evaluation)  Suppose  the  global  sets  of  tracks  and  hypotheses 
are  formed.  How  can  we  evaluate  the  probability  of  each  hypothesis 
using  the  probabilities  of  the  predecessor  nodes?  Also,  how  should  the 
state  distributions  of  the  tracks  be  computed? 

The  two  problems  would  now  be  discussed  separately. 
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2.3.2  Hypothesis  formation 


As  we  discussed  before  In  Section  2.1,  not  all  local  tracks  and  hypotheses 
can  be  fused  to  form  meaningful  global  tracks  and  hypotheses.  Our  philosophy 
behind  Information  fusion  Is  to  reconstruct  the  Information  state  X1(Z)  starting 
from  the  Information  states  H(Z, ).  This  means  that  two  tracks  can  only  be  fused 
if  there  exists  a  global  track  which  Is  consistent  with  them.  This  Is  also  the  idea 
behind  the  fusion  of  hypotheses.  The  following  are  some  definitions  needed  to 
formalize  this  concept. 

Consider  any  two  measurement  Index  sets  7,  and  72  with  72C7,.  For  each 
track  r  In  T(7,)  the  restriction  of  the  track  r  on  J2  is  defined  as  tC[J2,  l.e.,  the 
track  consisting  of  only  those  measurement  Indices  in  72.  We  usually  say  that 
the  track  r  is  a  successor  of  Its  restriction  tC\J2  or  conversely,  rC\J2  Is  the  prede¬ 
cessor  track  of  r.  Similarly,  for  each  hypothesis  X  In  H (7,),  the  restriction  of  the 
hypothesis  X  on  J.,  Is  defined  to  be 

X  |  7  =  {rC\J  |  r€X}\  {0}  (2.19) 

i.e.,  a  hypothesis  whose  tracks  are  those  of  X  restricted  to  J2.  The  concepts  of 
predecessor  and  successor  hypotheses  can  be  defined  as  In  tracks. 

Let  (7,)l6/  be  an  arbitrary  tuple  of  measurement  Index  sets  where  /  Is  an 

arbitrary  nonempty  set.  I  does  not  have  to  be  related  to  the  Information  graph 

at  all.  Then  any  tuple  (r,),6/  of  tracks  In  nT(7t)  is  said  to  be  /usable  If  there 

«€/ 

exists  a  track  t  In  T(U  7, )  such  that 
>€/ 

rClJi  =  r,  (2.20) 

for  all  i6/.  r  Is  a  track  obtained  by  fusing  the  tracks  In  the  tuple.  Similarly  any 
tuple  (X,  ),€/  of  hypotheses  In  nH(J,  )  Is  said  to  be  /usable  If  there  exists  a 

iC.t 

hypothesis  X  In  H(U  Jl  )  such  that 

X  |  J,-  =  X,  (2.21) 

for  all  «6/-  Fusablllty  of  tracks  thus  means  that  there  exists  a  possible  global 
track  such  that  each  of  the  local  tracks  represents  a  restriction  of  the  global  track 
to  the  local  measurement  Indices.  Similarly  the  fusablllty  of  the  hypotheses 
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means  there  exists  a  global  hypothesis  such  that  each  local  hypothesis  Is  a  restric¬ 
tion  of  the  global  hypothesis  to  the  local  measurement  Index  set,  or  more 
specifically,  the  nonempty  restrictions  of  the  tracks  In  the  global  hypothesis  are 
the  local  hypotheses. 

If  the  measurement  index  sets  (J,  ),e/  do  not  intersect,  fusabllity  of  tracks 
and  hypotheses  is  trivially  assured.  When  the  measurement  Index  sets  do  over¬ 
lap,  we  have  to  be  concerned  about  the  consistency  In  the  tracks  and  hypotheses. 
The  following  rather  intuitive  conditions  for  checking  fusabllity  are  proved  In  the 
appendix. 

1.  Any  track  tuple  (r,  ),e/  In  )  Is  fusable  If  and  only  If 

i€/ 

r,in(/,in/.J)  =  T.pupjiJ  (2.22) 

for  all  (t|.*a)€/  X/. 

2.  Any  hypothesis  tuple  (X,  ),€/  in  IlH(  J, )  is  fusable  if  and  only  If 

•  €/ 

x,1i(J,iru,J)  =  x,j(y,irViJ)  (2.23) 

for  all  (i',,ta)€/X/. 

These  two  conditions  state  that  a  tuple  of  tracks  (or  hypotheses)  Is  fusable  If  and 
only  If  they  share  common  predecessors  (In  tracks  or  hypotheses)  In  the  overlap¬ 
ping  measurement  Index  set 

7  =  |  (»i.»2)€/  X/  such  that  (2.24) 

To  check  the  conditions  described  by  (2.23)  or  (2.24),  we  need  to  have  tracks  and 
hypotheses  defined  on  the  set  7.  In  general,  these  are  not  directly  available  since 
there  may  not  be  any  Information  node  with  7  as  Its  measurement  Index  set. 
However,  by  using  the  decomposition  algorithm  of  equation  (2.6),  we  can  express 
the  set  7  as  the  union  of  the  measurement  Index  sets  of  some  predecessor  nodes 
In  the  Information  graph.  The  two  fusabllity  conditions  of  equations  (2.22)  and 
(2.23)  can  be  further  reduced  to  the  following. 
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Let  »„  be  a  communication  receiving  node  and  /  be  the  set  of  all  the 
Immediate  predecessors  of  It.  For  each  (t,,«2)€/X/,  let  /(«,, i2)  be  a  set  of  Infor¬ 
mation  nodes  T  such  that  7<»,  and  «<i2,  l.e.,  their  common  predecessor  nodes. 
Then,  we  have 


1.  a  necessary  and  sufficient  condition  for  any  track  tuple  (r,  ))€/6nT(y, ) 

t  6/ 

to  be  fusable  is  that,  for  any  (»,.*2)€/  X/, 

~  (2.25) 

for  any  «€/(*'  1.t‘2),  and 


2.  a  necessary  condition  for  any  hypothesis  tuple  (X,  ),e/  61111(7, )  to  be  fus- 

«€/ 

able  is  that,  for  any  (i,,t2)€/  X/, 

Xi,  I  J<7)  =  X„  I  J{ 7,  (2.26) 

for  any  «e7(i,,t2). 


In  general,  for  any  two  distinct  nodes  t,  and  »2,  their  common  predecessor 
set  7(«,,«2)  may  not  be  unique.  However,  to  use  the  above  conditions  to  test  the 
fusabillty,  we  need  only  to  consider  the  set  of  all  the  maximum  elements  In  the 
set  {7el  |  r<i>ndr<i2},  l.e.,  the  maximum  common  predecessor  set.  Thus  In 
the  cyclic  communication  example  of  Figure  2-4,  a  track  from  the  node  (tCR  ,i) 
and  one  from  the  node  (tCR  ,2)  are  fusable  If  and  only  If  they  have  the  same 
predecessor  (or  restriction)  tracks  in  both  the  nodes  (tCT  2,1)  and  (tCT  1,2). 

The  test  defined  by  (2.25)  provides  a  necessary  and  sufficient  condition  for 
track  fusabillty  but  equation  (2.26)  only  provides  a  necessary  condition  for 
hypothesis  fusabillty.  This  Is  due  to  the  fact  that  a  fusable  tuple  of  tracks  pro¬ 
duces  only  one  fused  track  but  a  fusable  tuple  of  hypotheses  may  produce  more 
than  one  hypotheses.  The  counterexample  In  Figure  2-5  shows  that  (2.26)  Is  not 
a  sufficient  condition  for  the  hypothesis  fusabillty.  In  this  example,  the  two 
hypotheses  (X,,X2)  are  to  be  fused.  The  common  predecessors  of  the  nodes  1  and 
2  are  nodes  3  and  4.  It  Is  obvious  that  X,  |  7;,=X2  |  7.,  and  also  X,  |  7  ,  -  X2 1  7,, 
thus  satisfying  the  necessary  condition  of  (2.26)  for  hypothesis  fusabillty.  In  fact, 
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Figure  2-5:  Counterexample 


this  is  true  since  both  X,  and  X2  are  the  results  of  fusing  X3  and  \4.  However, 
since 


X|  I  I  (2.27) 

the  hypothesis  fusablllty  condition  of  (2.23)  is  violated.  This  is  again  obvious 
since  X,  and  X2  are  mutually  exclusive.  X,  hypothesizes  that  r0  and  rd  are  from 
the  same  target  whereas  X2  hypothesizes  that  ra  and  rd  are  from  different  targets. 

Although  it  is  not  sufficient  to  determine  hypothesis  fusability  by  consider¬ 
ing  only  the  predecessors  of  the  hypotheses  in  the  predecessor  nodes,  the  condi¬ 
tion  (2.28)  can  be  used  to  eliminate  hypotheses  for  further  consideration  if  they 
do  not  have  the  same  predecessor  hypothesis  in  a  common  predecessor  node. 
Furthermore,  the  following  equivalence  condition,  proved  In  the  appendix,  relates 
hypothesis  fusability  to  track  fusablllty. 
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Hypothesis  Fusability  Condition.  Let  ( J,  ),c/  be  any  tuple  of  measurement  Index 

sets  and  J  —  Then,  any  (X,  )l€/£riH(./, )  Is  fusable  with  fused  hypothesis 

•'€/  iei 

XeH (J)  If  and  only  If 

1.  for  any  r  In  X,  there  exists  a  fusable  track  tuple  (r,  )l6/ 6ri(Xt  D{0})  such 

ie/ 

that  r=  (J  r, .  and 
iei 

2.  for  all  i  £/  and  for  all  r,  €X,  ,  there  exists  a  unique  t  In  X  such  that  r,  Cr. 

Condition  1  states  that  every  track  r  In  the  hypothesis  X  Is  formed  by  taking  the 
union  of  the  fusable  tracks  In  the  local  hypotheses.  Condition  2  states  that  every 
t,  belongs  to  a  unique  global  track  In  any  given  global  hypothesis. 

Hypothesis  formation  thus  consists  of  the  following  steps: 

1.  Use  the  necessary  condition  of  (2.26)  to  reduce  the  candidates  for  fus¬ 
able  hypothesis  tuples 

2.  Use  the  track  fusability  condition  of  (2.25)  to  further  determine 
hypothesis  fusability 

3.  Exhaust  all  possible  fusable  hypothesis  tuples,  and  for  each  fusable 
hypothesis  tuple,  generate  all  possible  fused  hypotheses. 

The  last  step  Is  concerned  with  the  actual  hypothesis  formation  and  consists  of  a 
two-level  procedure.  The  first  level  performs  hypothesls-to-hypothesls  associa¬ 
tion.  The  second  level  carries  out  the  actual  track-to-track  association  to  form 
global  tracks  from  the  fusable  track  tuples. 
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2.3.3  Hypothesis  evaluation 


Given  the  global  hypotheses  and  global  tracks  constructed  from  the  local 
hypotheses  and  local  tracks,  the  objective  of  hypothesis  evaluation  Is  to  compute 
their  probabilities  and  state  distributions  using  the  communicated  local  Informa¬ 
tion.  In  terms  of  the  Information  graph,  the  problem  is  as  follows.  Let 
i(>  (t,n,CR)  be  a  communication  receiving  node  in  Ir/{  and  /  be  the  set  of  all 

the  immediate  predecessors  of  i'(l.  Let  Z  —  U  Z,  with  K  and  J  be  the  associated 

re/ 

index  set  and  measurement  index  set.  We  need  to  compute  the  probabllltes  of  all 
hypotheses.  (P  (A=X  |  Z  ))\eH<  J  i*  the  state  distributions  of  the  tracks, 
(p,(x  |  Z  j ,,  and  the  expected  number  v{K  )  of  undetected  targets. 

We  make  the  standard  assumptions  on  the  target  and  sensor  models  (see  [1] 
or  [2]).  In  particular,  the  target  models  are  assumed  to  the  Independent  and 
identically  distributed  Markov  processes  and  the  number  of  targets  is  Poisson  dis¬ 
tributed.  The  sensor  measurements  generated  by  sensors  at  different  times  are 
conditionally  Independent  given  the  target  state.  In  addition  to  these,  we  also 
make  the  special  assumption  that  the  target  state  is  either  static  or  bidirection¬ 
ally  deterministic  (which  makes  it  equivalent  to  a  static  process).  This  assump¬ 
tion  is  needed  to  make  the  algorithm  more  implementable.  Later  In  this  section, 
we  would  briefly  discuss  how  this  assumption  can  be  relaxed.  The  target  state  Is 
in  a  hybrid  variable  with  a  continuous  part  to  model  geolocatlon  type  variables 
and  a  discrete  part  to  model  classification  type  information.  For  convenience,  we 
define  a  hybrid  measure  n  on  the  state  space  to  be  the  direct  product  of  a  con¬ 
tinuous  measure  and  a  discrete  measure.  Then  any  Integral  with  respect  to  this 
hybrid  measure  is  a  sum  of  Integrals  over  the  continuous  part  of  the  state  space. 

With  these  assumptions,  the  following  hypothesis  evaluation  results  arc 
derived  in  the  appendix.  Let  (I  ,a)  be  the  pair  which  satisfies  the  condition  (2.13) 
of  Section  2.2.2.  Suppose  for  each  7&T,  the  probability  p(X|Z~)  for  each 
hypothesis  X  in  H(/-).  the  track  state  distribution  p(x  |  Z-.t)  for  each  track  r  in 
T(J-),  and  i\K-),  the  expected  number  of  undetected  targets  are  all  known.  Then 
for  every  hypothesis  X6H(J),  the  probability  of  the  hypothesis  being  true  is  given 
by 
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P  ((A  |  J  )~\  \  Z )  —  C  1  ]1  P((X|  Jr)|Zrr(7’  ^n^Ur.iZj^j)  (2.28) 

where  C  is  a  normalization  constant,  and 

L  (r-(ZrkeT>  =  f  $JT~P(X  I  ZT,(TDJT)Y,{T)fi(dx  )  (2.29) 

Is  the  likelihood  of  the  global  track  r.  The  expected  number  of  undetected  tar¬ 
gets  is  given  by 


*K)  =  1  (<6.(ZT)TeT)  =  / n  p(.x  I  ZT,9)atrWdx ) 


(2.30) 


where 


~p(x  |  Zj,r)—p  (x  |  ZT.TMKzf'ir), 

er(')  =  !o 


,  |frfli7=0 
otherwise 


The  state  distribution  of  the  track  r  can  be  updated  by 

p(r  |  t,Z)  =  c  1  II  p(z  I  (rn^r),Zr),H,> 
•  eT 

where  c  Is  a  normalization  constant. 


(2.31) 

(2.32) 


(2.33) 


We  note  first  of  all  that  hypothesis  evaluation  depends  only  on  the  statis¬ 
tics  at  the  information  nodes  In  the  set  / .  This  is  the  same  set  used  in  distri¬ 
buted  estimation  and  represents  the  nodes  which  are  relevant  for  fusion.  The 
function  a  determines  whether  the  Information  at  a  node  should  be  added  or  sub- 
stracted.  The  hypothesis  evaluation  formula  of  (2.28)  has  a  two-level  structure. 
At  the  higher  level,  the  product  of  the  local  hypothesis  probabilities  evaluates  the 
probability  of  associating  the  given  set  of  local  hypotheses.  The  next  level  con¬ 
sists  of  the  likelihoods  of  the  individual  tracks. 

Each  L  (t.(Zj)j^j)  is  a  track-to-track  association  likelihood,  i.e.,  the  likeli¬ 
hood  of  associating  all  the  tracks  in  the  local  track  tuple  with  one  tar¬ 

get  represented  by  the  global  track  r  which  Is  their  union.  Its  evaluation  depends 
on  the  state  distributions  of  the  local  tracks.  If  the  tracks  have  similar  state 
descriptions  then  the  Integrand  in  equation  (2.29)  will  be  large,  thus  resulting  in  a 
high  likelihood.  On  the  other  hand,  if  the  local  tracks  have  state  descriptions 
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which  are  very  different,  the  Integrand  In  (2.29)  will  be  small,  resulting  In  a  low 
likelihood.  In  equation  (2.29),  the  function  p(x  j  Zj.t)  Is  Identical  to  p{x  ]  Z-.t), 
the  state  distribution  for  track  r.  when  the  track  r  has  a  nonempty  restriction  at 
the  node  t .  When  this  Is  not  the  case,  l.e.,  the  track  r  has  not  been  detected  yet 
at  T,  the  function  p  is  scaled  by  the  expected  number  of  undetected  targets  and 
Is  no  longer  a  probability  distribution.  It  represents  some  kind  of  density  for 
undetected  targets. 

Equation  (2.30)  computes  the  expected  number  of  undetected  targets  by 
fusing  the  local  track  state  distributions  of  the  undetected  targets.  Equation 
(2.33)  is  the  fusion  formula  for  the  global  track  state  distribution.  Note  that  it 
has  the  same  form  as  (2.13).  This  is  not  at  all  surprising  since  given  a  particular 
track,  computing  the  state  distribution  of  the  target  Is  the  usual  estimation  prob¬ 
lem.  Thus  the  fusion  algorithm  for  distribution  estimation  Is  an  Integral  part  of 
fusion  for  multitarget  tracking. 


2.4  CONCLUSION 

In  this  section,  we  have  described  the  results  of  our  research  on  Information 
fusion  for  multitarget  tracking.  We  have  identified  two  main  problems  In  Infor¬ 
mation  fusion  assuming  arbitrary  communication.  The  first  Is  how  to  generate 
meaningful  tracks  and  hypotheses  starting  from  a  set  of  local  tracks  and 
hypotheses.  The  second  is  how  to  compute  the  statistics  on  these  tracks  and 
hypotheses  when  the  local  quantities  may  contain  common  Information  due  to 
past  communication. 

We  have  developed  an  abstract  model  of  the  DSN  In  terms  of  the  informa¬ 
tion  graph.  Using  this  graph,  algorithms  for  information  fusion  have  been 
developed.  The  two  problems  of  hypothesis  formation  and  evaluation  all  require 
keeping  around  histories  of  the  tracks  and  hypotheses  in  the  system.  Using  this 
history,  the  fusabllity  of  tracks  and  hypotheses  can  be  determined.  At  the  same 
time,  any  common  information  shared  by  their  statistics  can  be  identified  so  that 
It  would  not  be  double-counted.  When  specialized  to  broadcast  communication, 
we  can  show  that  the  general  fusion  algorithms  for  arbitrary  communication 
reduce  to  those  developed  In  the  previous  project. 
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The  hypothesis  formation  algorithms  for  fusion  do  not  depend  on  the  target 
models.  For  hypothesis  evaluation,  we  have  assumed  that  the  targets  are  static 
or  that  their  motions  may  be  approximated  by  "deterministic"  process  models. 
When  the  target  models  are  assumed  to  be  general  Markov  processes,  the 
hypothesis  evaluation  algorithms  have  the  same  form  as  In  (2.28)  to  (2.33).  How¬ 
ever,  the  state  of  a  track  would  have  to  be  a  trajectory  sampled  at  various  times 
and  computing  Its  probability  distribution  would  be  difficult.  Thus  the  difficulty 
of  extending  the  results  to  treat  general  Markov  models  Is  more  related  to  Imple¬ 
mentation  Issues.  On  the  other  hand,  as  long  as  the  target  motion  Is  fairly  regu¬ 
lar,  the  deterministic  process  models  we  have  assumed  may  be  quite  adequate. 
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3.  TRACKING  AND  CLASSIFYING  STRUCTURED  TARGETS 


This  section  covers  our  algorithm  development  efforts  on  so-caiied  struc¬ 
tured  targets  as  discussed  in  the  proposal.  The  treatment  of  dissimilar  sensors  is 
related  to  this  task  and  is  partially  discussed  in  this  section. 


3.1  INTRODUCTION 

By  structured  targets,  we  may  mean  two  different  concepts  in  multitarget 
tracking: 


(1)  targets  with  structured  states,  and 
( 2 }  structured  sets  of  targets. 

Since  each  individual  target  may  be  represented  on  an  individual  target  space, 
the  above  concept  (2)  is  one-level  higher  than  (1).  In  a  model  based  on  the  above 
concept  (1),  targets  are  still  treated  as  individual  objects  although  correlation 
among  them  can  be  considered  and  targets  may  be  governed  by  a  common  state 
as  a  group  of  targets.  This  kind  of  models  is  necessary,  when  a  multilevel 
identification  process  for  each  target  is  used  or  when  a  target  has  structured 
features.  Such  issues  are  related  to  the  problem  of  treating  dissimilar  sensors 
which  generate  measurements  corresponding  to  different  levels  of  the  structured 
target  state  space 

On  the  other  hand,  the  concept  (2)  is  essential  when  targets  are  In  fact 
organized  and  structured  In  units  at  various  levels.  A  typical  example  can  be 
found  in  military  units  such  as  army  — »  division  —  regiment  —  battalion  *  com¬ 
pany.  etc.,  in  the  military  hierarchy.  In  such  a  case,  the  number  of  targets  is 
typically  very  large  and.  if  they  arc  treated  as  independent  objects,  we  may  not 
be  able  to  assess  a  global  situation  based  on  the  outputs  from  any  reasonably 
functioning  target  tracking  system.  This  Is  so  because,  since  grouped  targets 
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usually  closely  spaced,  the  data-to-data  association  (or  scan-to-scan  correlation) 
may  become  very  difllcult  with  limited  computational  resources.  This  difficulty 
may  be  overcome  only  when  the  unit  structure  of  targets  Is  understood  and  taken 
Into  account  In  a  tracking  system.  Moreover,  the  global  assessment  of  all  the 
targets  as  a  single  structured  object  Is  Itself  an  Important  task  In  many  applica¬ 
tions. 

At  least  at  the  conceptual  level,  there  is  no  difficulty  in  treating  targets 
with  structured  states  and  dissimilar  sensors  in  the  sense  that  the  general  theory 
of  multitarget  tracking  already  developed  through  this  project  provides  an 
integrated  treatment  of  these  subjects.  Therefore,  in  the  following  subsections, 
we  will  mostly  discuss  structured  sets  of  targets.  Our  emphasis  is  the  develop¬ 
ment  of  a  general  theory  upon  which  we  may  produce  effective  algorithms  in 
many  different  applications.  This  should  serve  also  as  a  basis  for  developing  dis¬ 
tributed  algorithms.  Section  3.2  discusses  the  different  and  the  common  aspects 
of  the  two  different,  concepts,  (1)  and  (2).  In  Sections  3.3  and  3.4.  we  will  present 
our  first-cut  analysis  on  structured  sets  of  targets.  An  algorithm  is  derived  for 
two-level  structured  targets,  i.e.,  tracking  groups  of  targets.  The  future  direction 
of  our  algorithm  development  effort  will  be  discussed  in  the  concluding  section 
3.5. 

3.2  STRUCTURED  TARGETS 

A?  mentioned  before,  structured  targets  may  connote  two  different  con¬ 
cepts.  each  of  which  is  discussed  in  the  following  two  subsection. 

3.2.1  Targets  with  Structured  States 

A  typical  example  of  a  target  with  a  structured  state  space  may  be  seen  in 
an  ocean  surveillance  problem  In  which  target  classification  is  included  in  the 
tracking  task.  In  such  a  case,  each  target,  i  may  be  represented  by  state  [rf.if): 
if  is  the  continuous  part  representing  Its  geolocation  attributes  such  as  position, 
velocity,  etc.  if  Is  the  discrete  component  for  its  classification.  The  space  for 
component  if  is  structured  and  is  typically  represented  by  means  of  an 
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arborescent  (tree-like)  ordered  set  of  nodes  with  different  levels.  A  typical  set  of 
such  levels  consists  of  motion  group  -•  nationality  — »  category  — »  type  —  class  — 
Identification,  as  Illustrated  In  Figure  3-1.  In  Figure  3-1,  the  classification  tree  is 
only  partially  shown  and  there  are  presumably  many  subtrees  which  are  not 
shown.  The  a  priori  and  a  posteriori  probability  distributions  on  a  classification 
tree  arc  those  on  terminal  nodes.  The  probability  of  an  intermediate  node  n  can 
be  defined  as  the  sum  of  all  the  terminal  nodes  which  are  successors  of  n.  For 
any  level  /  In  the  classification  tree,  there  is  a  unique  predecessor  node  given  a 
terminal  node.  Therefore  It  is  very  straightforward  to  treat  sensors  with  meas¬ 
urements  at  different  levels.  Namely  each  sensor  observing  level  l  nodes  in  the 
target  state  tree  can  be  characterized  by  two  transitions,  l.e..  one  from  a  terminal 
node  to  a  node  at  level  l  and  the  other  from  a  node  level  l  to  a  measurement. 
The  first  one  Is  always  with  probability  one  while  the  second  can  be  specified  by 
the  sensor  characteristics. 

Therefore  there  Is  no  theoretical  difficulty  to  treat  targets  with  structured 
states  and  dissimilar  sensors  with  measurement  at  different  levels.  In  practice, 
however,  classification  trees  such  as  the  one  illustrated  in  Figure  3-1,  may  be 
very  complicated  and  the  number  of  terminal  nodes  may  be  simply  too  many  to 
handle  In  a  straightforward  way.  In  such  a  case,  we  need  additional  tools  to 
effectively  store  and  update  the  probability  distributions  on  the  entire  terminal 
nodes.  In  [3]  and  [4],  a  set  of  procedures  to  solve  such  problems  Is  shown  by 
means  of  an  example  of  ocean  surveillance.  Many  of  hypothesis  management 
procedures  devised  for  controlling  data-to-data  hypotheses  (e.g.,  those  described 
in  [3j  and  being  developed  in  the  current  project)  can  be  extended  to  provide  use¬ 
ful  tools,  e.g.,  hypothesis  pruning,  hypothesis  combining  and  clustering.  Further¬ 
more  effective  representation  of  probability  distributions  must  be  developed  it. 
order  for  such  management  systems  to  work  effectively.  For  example,  track  stale 
distributions  of  tracks  may  have  different  representations  depending  on  their 
status.  Distributed  processing  on  different  levels  may  also  be  an  effective  pro¬ 
cedure.  For  such  a  procedure,  the  theory  on  the  distributed  multitarget  tracking 
described  in  earlier  sections  is  directly  applicable. 

As  seen  in  Figure  3-1.  in  some  classification  trees,  all  the  terminal  nodes  an 
the  Idcntill  at  Ion  (name!  of  each  target.  In  oilier  words,  ihe  ldent  ideation  of  each 
target  is  kticwii  n  priori  and  I  tie  ultimate  goal  of  ••aeh  classification  i-  t. 
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Figure  '.i- 1 :  SI  met  ured  State  Space  for  a  Target 
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determine  each  Identification.  This  indicates  that  targets  are  it.  theory  not 
independent  from  each  other.  For  example,  suppose  it  is  known  that  there  are 
only  two  types  of  targets.  A  and  R,  and  that  there  are  10  type- A  targets  and  5 
type-11  targets.  Then  any  hypothesis  indicating  more  than  10  type- A  targets  is 
impossible  and.  if  a  hypothesis  has  fifteen  tracks  live  of  which  are  classified  as 
type  H.  the  remaining  ten  tracks  must  originate  from  type- A  targets.  However, 
in  many  cases,  tracking  and  classification  of  targets  can  be  performed  quite 
effectively  with  independence  assumptions  and  some  external  manipulation  to 
take  care  of  the  dependence  among  targets.  On  the  other  hand,  if  the  total 
number  of  targets  of  interest  is  small  and  each  of  them  is  identified  a  priori ,  the 
problem  formulation  based  on  targets  with  a  priori  identification,  i.e.,  an  algo¬ 
rithm  with  a  priori  tracks  and  hypotheses,  may  be  more  appropriate  than  that 
based  on  targets  without  a  priori  Identification. 


3.2.2  Structured  Sets  of  Targets 

A  typical  exampie  of  a  structured  set.  of  targets  is  shown  in  Figure  3-2  in 
which  a  division  In  an  army  is  shown  in  a  simplified  way.  Depending  on  the  type 
of  the  division,  the  composition  and  the  number  of  subordinates,  l.e.,  battalions 
have  a  certain  pattern.  The  same  kind  of  dependence  is  also  present  In  the  rela¬ 
tionship  bet  ween  the  subsequently  lower  levels.  This  kind  of  structure  produces 
another  dimension  to  the  multitarget  tracking  problems.  There  are  only  very  few 
theoretical  results  on  tracking  and  classification  of  structured  sets  of  targets. 
Besides  a  few  documents  referred  in  [5).  we  can  only  refer  to  a  couple  of  technical 
references,  [fi!  and  [7],  both  of  which  are  concerned  with  two-level  tracking,  i.e.. 
tracking  of  groups  of  targets,  but  treat  issues  pertaining  multiple  groups  in  a 
rather  ambiguous  manner.  On  the  other  hand.  A1  (Artificial  Intelligence)  -type 
approaches  were  used  in  much  more  complicated  environments  in  j8l  and  jt) 
which  are  concerned  with  ocean  surveillance  and  battlefield  unit  identification, 
respectively  (8)  uses  a  single-hypothesis  propagation  combined  with  a 
backtracking-like  recovery  scheme  while  [i)j  adopts  a  multl-hypot tiesis  approach. 
The  systems  described  in  [8]  and  [9]  may  he  viewed  as  hierarchical  systems  which 
may  lie  illustrated  as  in  Figure  3-3.  'Hie  procedures  represented  by  upward 
arrows  are  often  called  bottom- up  or  induction  processes  and  those  represented  by 
downward  arrows  top  down  or  deduction  processes. 
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While  the  decomposition  Illustrated  by  Figure  3-3  Is  certainly  a  key  to  suc¬ 
cessful  implementation  of  the  systems  described  In  [8]  and  [9),  each  hypothesis 
evaluation  cannot  be  performed  independently  in  general.  For  example,  in  track¬ 
ing  groups  of  targets,  we  must  hypothesize  possible  group  formation  from  input 
data  while,  at  the  same  time,  the  states  as  a  group  must  be  determined  and  then 
the  estimation  of  the  states  affects  the  evaluation  of  lower  level  hypotheses.  Even 
If  the  bottom-up/top-down  updating  Is  clearly  defined,  Iterations  may  be  neces¬ 
sary  for  such  processes  to  converge.  Moreover,  in  some  cases,  a  simple  bottom-up 
type  process  may  easily  be  overwhelmed  by  combinatorics.  Therefore,  at  least 
for  the  few  lower  levels,  we  may  need  an  Integrated  approach  rather  than  a 
decomposition  approach  taken  in  [8]  and  [9].  In  the  subsequent  subsections,  we 
will  try  to  establish  a  first-cut  analysis  which  treats  the  whole  structure  of  targets 
In  an  Integrated  manner. 


3.3  PROBLEM  FORMULATION 

This  subsection  defines  a  formalism  for  the  tracking  of  structured  sets  of 
targets  with  an  arbitrary  number  of  levels.  As  a  first-cut  analysis,  we  will  pro¬ 
pose  a  rather  simplistic  view. 


3.3.1  A  Mode!  for  Structured  Sets  of  Targets 

When  we  focus  on  each  node  in  Figure  3-2  and  its  immediate  successors 
rather  than  the  whole  picture,  we  notice  the  tree  is  composed  of  building  blocks 
each  of  which  has  the  same  structure.  Such  a  building  block  can  be  identified 
with  a  structure  of  a  state  representing  a  group  of  targets,  as  shown  in  Figure  3- 
4a.  In  tracking  and  classifying  a  group  of  targets,  the  totality  of  targets  can  be 
represented  by  (1)  [level  l]  the  total  number  of  targets  plus  a  common  target 
state  component  for  the  group,  and  (2)  [level  0]  the  states  of  individual  targets. 
(1)  is  one-lcvei  higher  than  (2)  since  (2)  cannot  be  defined  unless  the  number  of 
targets  Is  given  by  (1).  This  structure  can  be  extended  to  the  cases  where  multi¬ 
ple  groups  of  targets  are  present.  Such  a  case  may  be  represented  by  a  tree 
which  may  be  illustrated  in  Figure  3-lb.  Each  level  of  nodes  in  Figure  3-lb 
represents:  (I)  [level  2]  the  total  number  of  groups  plus  a  common  state 
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component  for  all  the  groups,  (2)  (level  1]  the  states  of  Individual  groups  includ¬ 
ing,  for  each  group,  the  number  of  targets  in  the  group  and  a  common  state  com¬ 
ponent  for  all  the  targets  in  the  group,  and  (3)  (level  0]  the  states  of  individual 
targets  in  each  group. 


This  approach  can  be  extended  to  an  arbitrary  level  /  of  structures.  We 
call  such  a  structure  a  level-l  target  structure  or  simply  a  level-l  target.  As  seen 
in  Figure  3-4,  when  a  tree  represents  a  level-/  target  structure,  the  nodes  in  the 

tree  can  be  labeled  as  level  0,  level  1 .  level  /.  There  Is  always  only  one  node 

at  the  highest  level,  l.e.,  level  / .  The  nodes  at  the  lowest  level,  i.e.,  level  0. 
represents  the  set  of  all  the  targets  which  we  may  call  level-0  targets.  In  a  formal 
description,  we  define  a  level-l'  stale  for  a  level-l '  target  i  as 

(3.1) 


.(/')  _ 


U't  _  <n  ii 


=  W'  Wo  ’  , 


~  (I'-l)  \ 


where  Is  the  number  of  the  level-(l’-l)  targets  in  the  level-/'  target  t, 

is  the  state  component  common  to  all  the  level-// I )  targets  contained  in  level-/' 
target  i,  and  each  z,y,'  n  is  the  state  of  the  j-th  level-// '-1)  target.  Unless  l'~  l 
in  (3.1),  every  z,}‘  ~l)  is  defined  similarly  with  /'  being  replaced  by  / '— i .  When 
/'=/,  there  Is  no  need  to  use  Index  «  In  (3.1).  Bach  level-/'  target  when  /'</  is 
therefore  Indexed  as 


«  =  (*/-i . «/')  • 


(3.2) 


According  to  an  alternative  view  of  this  approach,  we  are  first  given  a  set  of 
targets,  then  a  partition  of  the  targets  Into  multiple  groups,  then  a  partition  of 
the  groups  into  multiple  super-groups,  and  so  forth.  In  other  words,  a  level-/' 
target  is  an  element  of  a  partition  of  the  set  of  all  the  level-/ / '—  l )  targets.  The 
partition  is  a  trivial  one  when  /'=/.  In  typical  battlefield  units  as  shown  in  Fig¬ 
ure  3-5,  each  unit  has  Its  headquarter  (division  command  post  (DCP),  regiment 
headquarter  (RH),  battalion  headquarter  (BH),  etc.)  besides  Its  subordinates  (R  = 
a  regiment,  B  =  a  battalion,  C  =  a  company,  etc.).  These  headquarters  may  be 
considered  either  (1)  as  a  part  of  the  common  state  of  each  level-/'  target  or  (2) 
as  special  targets  which  do  not  have  any  subordinate.  When  we  adopt  the  latter 
consideration,  we  may  simply  extend  each  headquarter  node  to  the  lowest  level, 
l.e.,  level  0.  As  mentioned  before,  as  a  first-cut  analysis,  we  Ignore  such  prob¬ 
lems.  There  will  be  no  problem  In  rectifying  the  formulation  to  treat  headquar¬ 
ters  In  appropriate  ways  in  the  future. 
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Figure  3-5:  Battlefield  I'nlls 


3.3.2  Sensor  Models  and  Multi-Level  Tracks  and  Hypotheses 

We  can  extend  our  target-sensor  model  for  multitarget  tracking  from 
single-level  cases  to  multi-level  cases  in  a  rather  straightforward  way  as  follows: 
Let  5  be  a  finite  set  of  sensors  which  observe  the  targets.  For  each  sensor  s  ,  the 
measurement  value  space  Y,  In  which  measurements  from  sensor  s  take  values  Is 
assumed  to  be  a  hybrid  space.  Each  output  from  sensor  s  Is  a  data  set 
(t/, . ym  ,m  .t  ,s  )  which  is  an  element  of 

U  U  (Y,  )m  X{m  }X|f0.oo)X{a  } 

m  =0  §  £S 

and  represents  m  measurements,  y, . ,ym  ,  generated  by  sensor  s  at  time  t.  ( (0 

Is  the  time  before  which  no  sensor  outputs  any  data  set.)  A  collection  of  data  sets 
available  up  to  a  certain  time  is  called  a  cumulative  data  set.  We  assume  that  all 
the  data  sets  are  indexed  by  positive  Integers  as  z(i),z(2), . .  where 

*(*)  =  ((»><*  (k).tk  ,sk)  (3.3) 

for  each  positive  k  such  that  tk<tk,  whenever  k  <k'.  A  cumulative  measurement 
set  up  to  k  is  defined  as 

j{k)=  U  {1 . NM(k')}x{k’}  (3.4) 

i 

For  the  sake  of  simplicity,  we  assume  that  possible  origins  of  measurements 
in  any  data  set  are  only  Ievel-0  targets.  Let  If  be  the  set  of  level-0  target 
indices.  For  each  data  set  k ,  we  assume  an  assignment  function  Ak  defined  on  a 

subset  of  the  level-0  target  index  set  Ir  taking  values  in  J(k)  4  (l . i\rk<{k}}. 

When  j  ~-Ak(ii_,, . we  say  level-0  target  .  .  .  ,  i0)  Is  detected  by  sensor 

sk  at  time  tk  and  generates  the  ;  -th  measurement,  or  the  ;  -th  measurement  ori¬ 
ginates  from  level-0  target  (»,_,,  .  .  .  ,  «,,).  With  the  no-spiit/no-merged  measure¬ 
ment  assumption,  such  an  Ak  Is  a  well-defined  one-to-one  function.  Then,  given 
a  cumulative  data  set,  we  can  define  the  trace  of  a  level-/'  target  in  it  in  the  form 
of  a  subset  of  the  cumulative  measurement  index  or  a  collection  of  such  subsets 
at  the  given  level.  We  call  any  possible  realization  of  such  a  trace  a  level-l' 
track.  Thus  a  subset  of  the  measurement  index  set  is  a  level-0  track  If  it  contains 
at  most  one  measurement  Index  set.  for  each  data  set.  A  level-/'  track  is  a  collec¬ 
tion  of  nonovcrlupping  level-//' -i>  tracks.  A  lrvcl-1'  hypothesis  is  then  a 
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collection  of  nonoverlapping  nonempty  level-/'  tracks  and  hypothesizes  all  the  set 
of  measurements  originating  from  level-/'  targets.  According  to  this  definition,  a 
level- 1  track  Is  also  a  level-0  hypothesis,  and  thee  versa,  although  Its  Interpreta¬ 
tion  as  a  track  Is  completely  different  from  that  as  a  hypothesis. 

Multi-level  hypotheses  defined  above  may  be  Illustrated  in  Figure  3-6  in 
which  /  —3  and  a  level-2  hypothesis  Is  represented  by  a  tree  depicted  by  solid 
lines.  In  Figure  3-6,  the  level-2  hypothesis  consists  of  two  level-2  tracks  each  of 
which  hypothesizes  a  group  of  detected  groups  of  targets,  {{r,,r.,},{r;,,rl}}  or 
{{T-.}.{r,i.Tr}},  where  r,  to  r-  are  level-0  tracks  each  of  which  hypothesizes  a 
detected  level-0  target.  Given  such  a  hypothesis,  we  must  further  hypothesize 
the  existence  of  undetected  targets  and  the  overall  structure,  as  shown  In  Figure 
3-6  by  broken  lines.  The  process  to  group  given  level-0  tracks  r,  to  r7  In  a  level-0 
hypothesis  Into  a  level- 1  hypothesis  and  then  into  a  level-2  hypothesis  can  be 
viewed  as  a  bottom-up  procedure.  While  the  process  to  add  hidden  targets  and  to 
complete  the  overall  structure  can  be  viewed  as  a  top-down  procedure.  The 
evaluation  of  hypotheses  may  not  be,  however,  decomposed  in  such  a  manner. 
The  discussion  of  hypothesis  evaluation  in  a  general  level-/  case  may  be  very 
complicated.  Therefore,  in  the  following  sections,  we  will  restrict  ourselves  to  the 
cases  where  /  =2,  i.e.,  where  tracking  of  multiple  groups  of  targets  Is  concerned. 

Remark:  In  the  above  discussion,  we  only  considered  the  cases  where  each 
measurement  from  each  sensor  Is  based  on  a  level-0  target.  The  definitions  of 
tracks  and  the  hypotheses  may  be  altered  so  that  measurements  from  different 
levels  may  be  treated.  At  this  moment,  however,  the  exact  form  of  the  appropri¬ 
ate  modification  is  not  very  clear. 


3.4  EVALUATION  OF  TWO-LEVEL  HYPOTHESES 


In  this  subsection,  we  will  extend  our  general  theory  of  mu  III  target  tracking 
from  single-level  cases  to  two-level  cases,  l.e.,  tracking  multiple  groups  of  targets. 
The  issues  pertaining  to  implementation  will  be  briefly  discussed  in  terms  of  an 
example. 
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3.4.1  Two-Level  Multitarget  Tracking 


When  the  target  structure  level  Is  two,  he.,  1=2,  the  overall  target  state 
can  he  written  as 


/  —  (NCi  .x„.x, . xNi; )  (3.5) 

where  Arf;  is  the  total  number  of  groups,  x0  is  the  state  component  common  to  all 
the  groups,  and  each  x,  is  the  «-th  group's  individual  state.  Each  x,  is  therefore 
in  form  of 


x,  =  (Af.x.o.x, . xl7V)  (3.6) 

where  N,  is  the  number  of  (level-0)  targets  in  group  i,  xl0  is  the  state  component 
common  to  all  the  targets  in  group  «,  and  is  the  individual  states  of  the  j-th 

target  In  group  «.  Let  the  level-1  target  index  set  be  /6-={l . Nc }  and  the 

No 

level-0  track  index  set  be  U  { *  }  X  { l TV,- }.  Then  the  trace  of  level-0  target 

i  =  1 

(*  he.,  the  »0-th  target  in  the  *  ,-th  group,  in  a  cumulative  data  set  up  to  k  is 


Tkw(il,i0)  =  {U,k')U=At,(i„i0Xl<k'<k}  .  (3.7) 

The  trace  of  level- 1  target  «,  Is  then 

7*"^,)  =  {n,0)(«  ,.«o)  I  .  (3.8) 

Then  a  level-0  hypothesis  is  a  possible  realization  of 

A t!0)  =  {  V°\i  ,.•**»)  I  n°\i  ,.«o )*Ui  P«o)6/r  }  (3-9) 

and  a  level-1  hypothesis  is  a  possible  realization  of 

Ai“  =  mn)(«.) inl,,(«,)^{0}, «■,€/«}  .  (3.io) 


We  can  extend  the  concept  of  target-to-track  hypothesis  from  single-level  tracking 
to  two-level  tracking  as  follows:  A  level-1  target-to-track  hypothesis  is  a  possible 
realization  of  a  one-to-one  random  function  from  A*"  to  I(;  defined  by 

=  i  (3.11) 

and  a  level-0  target-to-track  hypothesis  is  a  possible  realization  of  a  one-to-one 
function  from  7V"(t)  to  {l . N, }  (given  Tk"\i))  defined  by 
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nnO>..‘o);7V>,))= 


(3.12) 


As  in  the  theory  of  single-level  multitarget  tracking,  whenever  we  must  distin¬ 
guish  a  realization  of  A*'"'  from  that  of  l)**’1,  we  call  the  former  data-to-data 
hypothesis. 


3.4.2  General  Results 


We  will  derive  a  recursive  formula  for  calculating  each  level- 1  hypothesis. 
The  results  are  an  extension  of  the  single-level  tracking  results.  For  the  rest  of 
this  section,  we  make  the  standard  set  of  assumptions:  (1)  Targets  are  Inter¬ 
changeable  a  priori.  (2)  The  data  sets  are  conditionally  independent  given  the 
target  states.  (3)  The  assignment  functions  are  totally  random.  The  first  step  Is 
a  straightforward  recursive  formula 


F<A‘  ;Z  1 - /><£'*  Mz"  ”)  ,,,! 


(3.13) 


The  numerater  on  the  RHS  of  (3.13)  can  be  expanded  In  a  way  similar  to  that 
used  for  the  single-level  tracking  (as  described  In  [lj  and  [2])  and  yields 


P( A/"!  £<*') 


P( aIW  i  z(*-u) 

P(Z,k)l  Z{k>)) 


(3.U) 


H  <*«-<■  <a«W 

( Ng -#  (A*1  ))! 


A 


L  11  TTT-'-lT-^  P(N<:  I  Na.nM\.Z'k  " 


)  (i  (A:  )  ]  A*  ,.V 


where 

-  (/Vf;.A, . A\,.) 


and 


Lk(z{k).Ak.N(!  !  Z,k  ") 


Nutk  1! 


(3.15) 


(3.  in) 
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/ P  ((»,(*  ’  |  v4t  .Nu(t  ).x(l*  ).JV'; )  rKt(NK,(k  j  j  /„rt*  ).r(4  >oV'; ) 

The  updating  formulae  for  P(<£r(ft)|  .n*°,.Aj{,l1Z,t ').  P(Na  j  N(;  ,ilku,Akr.Z‘k ') 

and  P  ( S(:  |  a kl\Zik')  can  be  derived  In  a  similar  way. 


3.4.3  1. 1. D.- Poisson  Groups 

In  single-level  tracking,  an  appropriate  set  of  Independence  assumptions 
enables  us  to  reduce  a  general  form  Into  a  more  implementable  form.  We  will 
repeat  such  a  process  for  two-level  multitarget  tracking.  The  additional  assump¬ 
tions  are  as  follows: 

( 1  ]  C.lver.  the  number  N(;  of  groups,  the  group  states  tuple  (x,  ),■  J:\  Is  a  sys¬ 
tem  of  Independent  Markov  processes  which  share  common  joint  pro¬ 
babilities.  Thus  the  state  component  x0  common  to  all  the  groups  is 
Ignored.  The  number  N,;  of  groups  has  a  Frisson  distribution  with 
mean  l>„. 


[2]  Each  z,  —  (x.n.i,, . xlN  ),  given  Nt,  Is  a  stochastic  process  such  that 

N 

lxt]  )}L-i  Is  a  system  of  Interchangeable  Markov  processes. 

[3]  The  detection  Is  target-wise  Independent,  l.e.,  the  detection  of  target 
!  t .  «„)  depends  only  (x,  „.x,  ,  )  and  we  have 


P(/pr(*)  I  = 


(3.1' 


H  Pp  <c)<5(,,’,,,)(l  -  Pi>  (x,-  ii.x1-ii(|  |  k))' 

'  *  i  •  *  *  •  r 


with  a  common  detection  probability  function  pn. 

(d|  Measurement  errors  are  also  target-wise  Independent,  l.e..  the  value  of 
a  measurement  originating  from  a  target  1 1  is  correlated  only  to 
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( i,  The  number  of  false  alarms  and  iheir  values  are  Indepen¬ 

dent  of  the  targets  and  from  data  set  to  data  set.  Thus  we  have 


P(NMik)\  I„r(k).x(tk).N(!)  =  (NA,(*  )-#  (l,)T(k))  |  k)  (3.18) 


and 


N.Ak  ) 


P((Uj(k  ))”=,"  '  |  Ak  ,NM(k  ),x(tt  ),N<;  )  —  (3.19) 

(  FI  PM(ya*(.,..„i(fc)  I  *ifl(tk),xi  {  (tk  ),*))(  11  PFA  (Vj(k  )  |  k  )) 


with  a  number- of -false- alarm  probability  function  pNf.^ ,  a  target-state- 
to-measurement  transition  probability  density  function  pM ,  and  a  false- 
alarm-value  probability  density  function  pf  A  . 


Under  these  assumptions,  we  can  derive  results  which  are  very  analogous  to 
those  In  single-level  tracking  (described  in  [1]  and  [2])  and  are  summarized  as  fol¬ 
lows:  (1)  Given  a  level-1  target-to-track  hypothesis,  the  posterior  distributions  of 

N 

the  group  states  (*,),=,  are  independent,  (2)  the  posterior  distribution  of 
undetected  groups  becomes  Poisson,  and  (3)  the  hypothesis  evaluation  can  be 
reduced  to  the  evaluation  of  level-1  track-to-measurement  likelihood  as 


P (a/1  1 1  Z{k))  = 


P(l\\\Zlk-")  cxp^-^  ,) 
P(Zlk)\ Z{k  ") 


(3.20) 


Lfa  n  L(y{r\k}\Z\kT") 

rCA  (" 


whore  lfA  is  the  false  alarm  likelihood, 

J/H  k}  ~  {yj(k  )  |  (j  ,k  )eUr}  (3.21) 

is  the  set  of  measurements  assigned  to  level- 1  track  r  and  L(-\  Z\%  ")  is  the 
level-1  track-to-mcasurement  likelihood.  The  forms  of  the  above  likelihood  func¬ 
tions  are  very  similar  to  that  of  the  hypothesis  evaluation  formula  for  the  single- 
level  tracking  of  dependent  targets. 
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3.4.4  An  Example 


A  straight  forward  extension  of  single-level  tracking  to  two-level  tracking  Is 
possible  using  the  results  shown  In  the  previous  two  subsections.  In  two-level 
tracking,  however,  the  combinatorial  problem  Is  even  more  severe,  which  may 
make  a  straightforward  extension  of  single-level  trackers  infeasible  in  many  appli¬ 
cations.  For  this  reason,  we  may  have  to  develop  new  techniques  for  overcoming 
the  additional  combinatorial  burden  Inherent  to  two-level  tracking.  In  this  sub¬ 
section.  we  will  discuss  this  aspect  of  the  problem  In  terms  of  a  simple  example. 

We  consider  tracking  of  groups  of  ground  vehicles  moving  on  a  road  net¬ 
work.  By  a  two-step  transformations  to  take  care  of  (1)  the  route  selection  by 
each  group  and  (2)  the  curvature  of  each  road  segment,  the  problem  can  be 
reduced  to  that  of  tracking  groups  of  targets  moving  on  a  straight  line.  Let  u,  be 
the  1-dimensional  position  of  the  lead  vehicle  of  the  i-th  group  and  v,  be  its  velo¬ 
city.  Then  the  position  and  the  velocity  of  the  j'-th  vehicle  in  group  i  can  be 
modeled  as 


uij  =  «.  -  (;->)«. v,  +  iij  (3-22) 

and 

v,j  =  v,  +  rjij  (3.23) 

where  e,  v,  is  the  expected  distance  between  two  vehicles  in  group  i,  (tJ  and  r/,j 
represent  randomness  in  position  and  velocity  of  each  vehicle  in  the  group.  We 
assume  that  the  randomness  can  be  modeled  by  Independent  gaussian  random 
variables.  The  group  dynamics  are  then  assumed  to  be  a  simple  almost  constant 
velocity  model  with  an  appropriate  white  gaussian  driving  noise.  Thus  we  may 
have  a  very  simple  target  model  in  which  the  state  component  common  to  all  the 
targets  in  group  «  is 


x,o  —  <«. -vi )  (3.21) 

where  a,  Is  a  discrete  variable  representing  the  type  of  group  i.  The  individual 
target  state  of  the  ;-th  target  In  group  «  is  then  simply  Its  type  at]. 


For  each  possible  type  of  group,  we  assume  that  we  have  a  sulllcient 
number  of  templates  of  the  group  including  composition  of  different  types  of  vehi¬ 
cles  and  their  order  when  moving  on  the  road.  Each  template  can  be  represented 
by 

e=(a,N.b . bN)  (3.25) 

where  a  is  the  type  of  a  group,  N  is  the  number  of  vehicles  In  the  group  and  6, 
is  the  type  of  the  i-th  vehicle  in  the  group.  Therefore  the  level- 1  track  distribu¬ 
tion,  i.e..  the  group  state  distribution,  is  a  distribution  on  {-oo.oofxE ,  where  E 
is  the  set  of  ail  the  templates.  In  general,  we  may  assume  at  least  In  an  approxi¬ 
mated  sense  the  Independence  of  motion  from  the  type  component  as 
P  {du  ,dv  ,de  )=P  (du  ,dv  )P  (de  ). 

When  a  data  set  is  received  from  a  sensor,  each  group  hypothesis  is  given  a 
set  of  measurements  which  may  be  associated  to  it.  Then  the  set  of  measure¬ 
ments  is  ordered  linearly  and,  for  each  template,  the  level-1  track-to- 
measurement  likelihood  is  calculated  after  template-to-measurement  matching  as 
shown  in  Figure  3-7.  In  such  a  process,  we  must  use  a  very  effective  method  for 
determining  a  likely  level-1  track-to-measurement  assignment.  For  example,  for 
each  template,  we  first  estimate  the  most  probable  distance  between  targets 
based  on  the  velocity  estimate  and  then  spread  the  vehicles  in  the  template 
accordingly.  Then,  by  an  effective  assignment  algorithm,  we  can  find  a  feasible 
assignment  between  the  given  set  of  measurements  and  the  vehicles  In  the  tem¬ 
plate.  After  determining  the  assingment,  we  can  calculate  the  level-1  track-to- 
measurement,  likelihood. 


3-4.5  Distributed  Hypothesis  Formation  and  Evaluation 

As  stiown  earlier  in  this  report,  distributed  hypothesis  formation  is  a  pro¬ 
cess  of  creating  a  logically  consistent  set  of  hypotheses  from  a  collection  of  local 
sets  of  hypotheses.  This  process  amounts  to  the  consistency  checking  on  the 
overlapped  pieces  of  information  in  the  past.  It  Is  also  determined  purely  by  the 
definitions  of  tracks  and  hypotheses  and  Independent  of  their  probabilistic 
nature.  Therefore  it  is  expected  that  we  may  extend  the  single-level  tracking 
results  to  the  two- level  or  in  general  level-/  tracking  cases.  The  results  may  be  a 
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similar  typo  of  consistency  checking  on  the  predecessors  of  tracks  and  hypotheses. 
However,  although  the  final  results  are  fairly  simple  In  single-level  tracking  cases, 
complicated  steps  were  necessary  to  derive  lmplementable  results.  It  Is  hence 
expected  that  the  logical  arguments  involved  In  two-level  tracks  and  hypotheses 
may  well  be  very  complicated. 


On  the  other  hand,  distributed  hypothesis  evaluation  involves  the  distri¬ 
buted  estimation  and  is  highly  dependent  on  the  structure  of  the  global 
hypothesis  evaluation  formula.  In  the  single-level  tracking  cases  (with  the  1.1. d. 
Poisson  assumption),  as  shown  in  the  appendix,  the  hypothesis  evaluation  equa¬ 
tion  is,  in  essence,  a  product  of  track  likelihoods  and  each  track  likelihood  Is  an 
integration  of  a  product  of  state-to-measurement  transition  probability  densities. 
Thus  each  track  likelihood  can  be  decomposed  using  distributed  estimation 
theory.  In  two-level  tracking  cases,  however,  the  level-1  track-to-measurement 
likelihood  Involves  summation  over  many  possible  numbers  of  targets  in  each 
group,  which  may  cause  difficulty  in  decomposing  the  track  likelihood  into  the 
Independent  components.  We  may  well  need  a  kind  of  aggregation  of  tracks  and 
hypotheses  In  order  to  produce  a  workable  algorithm  for  distributed  hypothesis 
evaluation  for  the  two-level  tracking.  The  dynamic  behavior  of  groups  may  also 
complicate  the  discussions. 


3.5  CONCLUSION 

A  first-cut  analysis  on  multitarget  tracking  concerning  structured  targets 
were  discussed  in  this  section.  The  discussions  In  this  section  arc  summarized  as 
follows:  (1)  The  treatment  of  targets  with  structured  state  spaces  Is  at  least 
theoretically  straightforward.  (2)  The  treatment  of  such  targets  in  practice  may, 
however,  need  several  additional  consideration  and  more  aggressive  hypothesis 
management  strategies.  (3)  The  same  arguments  as  in  (1)  and  (2)  are  also  valid 
when  dissimilar  sensors  with  measurements  at  different  levels  are  concerned,  (-t) 
Structured  sets  of  targets  may  be  treated  in  an  integrated  form  and  concepts  of 
tracks  and  hypotheses  can  be  extended  from  the  single-level  cases  in  a  straight¬ 
forward  way.  (5)  Two-level  multitarget  tracking  hypothesis  evaluation  can  be 
done  by  extending  the  single-level  tracking  results.  (6)  Practical  methods  for 
Implementing  two-level  hypothesis  evaluation  needs  however  further 
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investigation.  (7)  Distributed  hypothesis  formation  and  evaluation  for  two-level 
tracks  and  hypotheses  may  be  possible  by  extending  the  single-level  results  but 
we  need  more  time  to  clear  this  problem.  The  future  efforts  pertaining  to  the 
topics  covered  in  this  section  may  Include:  (l)  effective  Implementation  of  single- 
level  tracking  with  correlation  among  targets,  (2)  implementation  of  two-level 
multitarget  tracking  algorithms,  and  (3)  development  of  distributed  level- 1 
hypothesis  formation/evaluation  algorithms. 
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4.  TOWARD  A  DSN  DESIGN  TESTBED 


In  this  section  we  describe  an  architecture  for  a  general  testbed  environ¬ 
ment  within  which  a  DSN  sytem  may  be  designed,  prototyped,  and  its  perfor¬ 
mance  capabilities  tested  on  a  simulation  of  the  task  domain.  The  major  aspects 
of  this  architecture,  called  Schemer ,  have  been  Implemented  and  used  for  the 
development  of  distributed  systems  similar  to  that  of  a  DSN  (I).  Judging  from 
the  success  we  have  had  with  early  versions  of  Schemer  for  distributed  system 
development  support  we  believe  that  a  complete  Schemer  system  can  provide  a 
development  environment  within  which  the  structure  of  a  DSN  system  can  be 
evolved  and  the  performance  abilities  of  alternative  techniques  for  sensor  and 
other  forms  of  Information  processing  (such  as  the  Bayesian  tracking  and 
classification  algorithm  being  Investigated  In  this  project)  can  be  "empirically" 
evaluated.  Moreover,  since  Schemer  Is  an  extension  of  techniques  for  AI  expert 
system  construction.  It  also  provides  direct  support  for  augmenting  non-AJ 
approaches  to  signal  processing.  Information  fusion  (both  signal  and  message 
level),  resource  allocation,  control,  etc.  by  combining  these  non-AI  alogorithms 
with  powerful  AI  heuristic  methods  for  problem  solving,  planning,  and  other 
forms  of  Intelligent  reasoning. 

Before  going  into  details,  let  us  give  an  overview  of  some  of  the  important 
assumptions  and  concepts  that  underlie  the  approach  being  taken  with  Schemer. 
The  Schemer  based  approach  to  be  described  in  more  detail  below  capitalizes  on 
the  notion  that  a  distributed  system  like  a  DSN  may  be  viewed  as  a  kind  of  dis¬ 
tributed  decision  making  (DDM)  system.  That  is,  each  node  (an  individual  pro¬ 
cessing  element)  In  a  DSN  system  may  be  viewed  as  a  more  or  less  independent 
"decision  maker"  reaching  conclusions  on  the  basis  of  Its  own  privately  acquired 
information  and  information  shared  with  other  nodes  in  the  overall  system.  'Phis 
"cognitive’  top  level  view  is  consistent  with  other  work  we  have  done  using  Sche¬ 
mer  as  the  basis  of  a  distributed  system  model  [11].  In  general  then  the  Schemer 
system  must  provide  a  context  within  which  to  model  all  the  following  aspects  of 
DSN  system  structure  and  function,  as  well  as  the  target  task  domain: 
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1.  The  event  stream  of  the  task  domain  to  which  the  overall  system  is 
exposed,  and  the  part  of  that  overall  event  space  to  which  each  node  in 
the  distributed  system  will  be  individually  exposed; 

2.  The  structural  relations  that  obtain  among  the  nodes  of  the  DSN  sys¬ 
tem.  including  the  communication  relations  among  the  nodes  and  the 
authority  or  control  relations  among  these  same  nodes;  and 

3.  The  performance  and  decision  making  abilities  of  each  node; 

4.  The  criteria  according  to  which  system  performance  should  be  judged. 
Including  specification  of  the  global  ’’goals”  and  task  requirements  of  the 
DSN  system  and  other  performance  criteria  that  constrain  how  these 
global  goals  should  be  met. 

More  should  be  said  about  the  metaphor  of  each  DSN  node  as  a  participat¬ 
ing  decision  maker  in  the  overall  distributed  system.  The  technology  of  AI 
Expert  System  (AI/ES)  construction  has  evolved  precisely  in  response  to  the 
need  to  provide  computational  models  that  incorporate  expertise  for  performance 
and  decision  making  in  some  task  domain.  In  this  sense  each  node  of  the  DSN 
system  can  be  thought  of  as  a  participating  ES  armed  with  its  own  local  expertise 
for  carrying  out  its  particular  functions  in  the  network  and  for  cooperating  with 
other  nodes  with  which  this  node  can  be  in  contact.  Furthermore,  this  viewpoint 
exposes  the  importance  of  the  idea  that  we  should  where  possible  incorporate 
available  human  expertise  in  the  capabilities  of  a  DSN  node  to  augment  other 
non-AI  methods  like  GTC.  Thus,  the  metaphor  or  a  DSN  as  a  network  of  deci¬ 
sion  making  participants  leads  to  the  view  of  a  DSN  as  a  cooperative  distributed 
expert  system. 

The  central  principles  of  the  Schemer  design  to  be  presented  below  derive 
from  the  need  to  provide  a  testbed  environment  in  which  to  explore  new 
approaches  to  the  design  of  knowledge  based  Expert  Systems  (ESs).  The  various 
alternative  ES  architectures  that  have  been  developed  by  the  AI  community  pro¬ 
vide  suitable  computational  models  of  human  expertise  for  performance  and  deci¬ 
sion  making  in  a  wide  range  of  domains  (12].  Schemer  therefore  is  intended  to 
provide  a  framework  for  constructing  a  system  out  of  some  combination  of  these 
AI  architectural  techniques  In  combination  with  non-AI  capabilities.  Further¬ 
more,  the  basic  Schemer  framework  has  been  developed  with  an  eye  toward  con¬ 
struction  of  distributed  Expert  System  networks. 
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In  the  following  discussion  we  will  briefly  sketch  the  requirements  on 
testbed  design,  and  then  present  our  Ideas  for  an  architecture  Intended  to  meet 
these  requirements.  As  noted  above,  this  architecture  can  be  viewed  as  a  kind  of 
framework  for  designing  and  protoyplng  distributed,  cooperative  expert  systems 
that  can  be  configured  for  a  wide  range  of  application  domains. 


4.1  REQUIREMENTS  FOR  A  DESIGN  TESTBED 

The  primary  categories  of  activities  that  require  support  are  DSN  system 
design  development,  rapid  prototyping  of  the  DSN  design,  and  prototype  evalua¬ 
tion.  Let  us  briefly  review  these  activities  and  the  requirements  that  each 
Imposes  on  a  system  intended  to  support  a  designer  engaged  in  each  of  them. 

The  support  of  design  development  Involves  two  principal  issues.  One  of 
these  is  support  for  specifying  some  candidate  design  for  the  DSN  system.  The 
other  Is  the  specification  of  the  tasks  to  be  performed  by  the  DSN  system  and  its 
constituent  elements  and  a  task  environment  In  which  the  system  will  operate. 

As  noted  above,  we  view  the  problem  of  specifying  a  DSN  system  design  as 
essentially  the  same  as  that  of  constructing  a  model  of  a  distributed  expert  sys¬ 
tem.  To  review  this  claim,  the  designer  models  the  Individual  elements  or  parti¬ 
cipants  In  the  DSN  network  by  defining  each  as  a  particular  expert  system  struc¬ 
ture.  Thus,  each  expert  system  Is  constructed  to  ’'model”  the  decision  making 
and  other  capabilities  that  a  DSN  node  must  be  able  to  provide  in  response  to 
specific  task  conditions  that  may  arise  as  the  entire  system  performs  its  overall 
activities.  The  designer's  specifications  for  the  capabilities  required  of  an  element 
are  modeled  as  the  expertise  of  the  expert  system  representing  that  DSN  element. 

In  addition  to  modeling  the  elements  of  the  system,  the  designer  must  also 
model  the  relationships  that  obtain  among  these  elements.  The  principal  types  of 
relations  among  system  elements  that  must  be  modeled  are  the  communication 
relations  and  the  control  (l.e.,  authority)  relations  that  exist  among  nodes.  There 
are  various  approaches  being  developed  by  the  AI  community  for  modeling  com¬ 
munication  and  control  relations  in  a  distributed  system  of  (potentially) 
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intelligent  agents.  In  other  work  completed  at  AJ&DS  [10],  we  have  reviewed 
some  or  the  major  issues  that  must  be  addressed  In  dealing  with  these  problems 
of  distributed  system  communication  and  control.  Schemer's  distributed  AI/ES 
approach  is,  prima  facie,  an  excellent  path  modelling  such  applications  such  as  a 
DSN.  However,  we  note  as  we  did  earlier  that  the  modeling  capabilities  of  a 
design  support  environment  should  also  support  the  modeling  of  other  ’'unintelli¬ 
gent"  types  of  system  elements  (e.g.,  a  remote  sensor  or  senor  system). 

The  task  context  in  which  the  DSN  system  operates  must  be  modeled  if  the 
designer  Is  to  explicitly  consider  the  relationship  between  candidate  design  and 
that  task  context.  In  order  to  support  the  DSN  system  designer  in  specifying  the 
task  requirements  and  task  environment  the  DSN  design  testbed  must  contain 
tools  for  modeling  the  objects  and  events  to  be  encountered  by  the  DSN  system 
as  it  performs  its  tasks,  and  also  descriptions  of  the  performance  expected  of  the 
DSN  system  itself.  The  design  testbed  must  provide  a  means  of  expressing 
scenarios  and  event  streams  that  can  be  fed  to  the  DSN  system  model  for  simula¬ 
tion,  the  next  major  capability  to  be  provided  in  the  design  testbed. 

Therefore,  using  the  expert  system  model  of  a  DSN  system  for  simulation  is 
the  approach  we  propose  for  prototyping  a  candidate  design.  Furthermore,  in 
order  to  promote  rapid  prototyping.  It  is  desirable  to  allow  the  designer  to  con¬ 
duct  simulations  while  aspects  of  the  total  system  design  are  incompletely  or 
generlcally  specified.  This  approach  to  the  prototyping  task  requires  a  testbed 
environment  which  contains  methods  for  using  the  models  of  the  task  context 
and  the  system  itself  to  simulate  the  performance  of  the  Intended  system.  More¬ 
over.  it  should  be  possible  to  abstractly  or  generlcally  specify  subsystems  of  the 
complete  system  and  still  perform  at  least  limited  simulations  of  system  perfor¬ 
mance. 

The  final  major  aspect  of  our  design  methodology  has  to  do  with  the  prob¬ 
lem  of  design  evaluation.  Designs  for  systems  of  the  complexity  of  DSN  systems 
do  not  readily  yield  to  analytical  methods.  Thus,  a  primary  value  In  providing 
the  kind  of  simulation  and  rapid  prototyping  capability  Just  discussed  is  so  that 
methods  for  empirical  analysis  can  be  used  where  analytical  approaches  to  design 
evaluation  are  not  available.  Furthermore,  it  Is  intended  that  these  observational 
techniques  be  used  as  early  a.s  possible  in  the  design  development  process  to 
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promote  rapid  convergence  on  a  satisfactory  design.  The  implication  of  these 
remarks  is  that  the  design  methodology  we  seek  to  Instantiate  should  provide  a 
mixed  approach  including  analytic  veriflcational  techniques  for  those  types  of  sys¬ 
tem  and  subsystem  designs  that  admit  such  analyses,  and  observation  based 
methods  of  evaluation  for  designs  sufficiently  complex  that  no  known  analytical 
evaluation  method  applies. 

We  can  now  look  at  the  specific  Schemer  architecture  as  an  approach  to  the 
construction  of  a  DSN  design  testbed  that  meets  the  design  support  requirements 
just  reviewed.  In  the  next  section  we  will  present  the  general  approach  to 
knowledge  representation  provided  in  Schemer  to  handle  both  DSN  system  and 
task  context  modeling.  Following  that  discussion  we  will  present  a  description  of 
the  design  of  the  Schemer  testbed  architecture  and  consider  the  kinds  of  tools 
needed  to  construct  a  DSN  protoptype,  run  simulations  with  it,  and  evaluate  its 
performance  in  terms  of  task  specifications. 


4.2  KNOWLEDGE  REPRESENTATION  IN  THE  DESIGN  TESTBED 

Our  discussion  of  knowledge  representation  will  proceed  in  parallel  with  the 
discussion  of  testbed  requirements  above.  First,  let  us  consider  an  approach  to 
modeling  a  single  DSN  node.  This  will  first  focus  on  how  a  designer  may 
represent  the  knowledge  held  by  a  node  that  allows  It  to  perform  its  function. 
This  will  also  require  that  we  show  how  this  node  is  controlled  in  some  general 
framework.  To  this  end  we  will  next  present  a  generic  expert  system  architecture 
within  which  the  capabilities  of  a  specific  DSN  component,  may  be  modeled. 
Finally,  we  will  look  at  the  relationships  among  nodes  specifically  considering 
how  communications  and  authority  relations  among  nodes  can  be  expressed. 

After  considering  how  to  represent  an  individual  node,  we  will  then  discuss 
how  the  task  environment  may  be  represented  in  the  design  testbed.  As  we  will 
see,  the  representational  requirements  for  this  aspect  of  modeling  will  largely  be 
another  application  of  the  techniques  that  we  have  developed  for  representing  the 
Individual  DSN  system  nodes'  internal  structure. 
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We  will  defer  discussion  of  design  tools  and  their  representation  until  after 
we  have  looked  at  the  overall  architecture  of  the  design  testbed.  This  we  will  do 
in  the  next  section. 


4.2.1  Node  representation  in  a  DSN  system 

We  begin  now  by  discussing  our  approach  to  modeling  a  node.  Consider 
first  the  knowledge  that  may  be  held  by  a  node.  We  need  to  consider  the  follow¬ 
ing  four  categories: 

a.  Static  (l.e.,  relatively  permanent)  knowledge; 

b.  Situational  (current  context)  knowledge; 

c.  Planning  knowledge;  and 

d.  Control  knowledge. 


4. 2. 1.1  Static  knowledge 

Static  knowledge  refers  to  the  relatively  unchanging  knowledge  that  a  node 
has  of  the  objects  and  events  In  the  task  domain.  This  will  include  other  nodes 
in  the  DSN  system  as  well  as  objects  external  to  the  system.  In  this  project  and 
in  previous  research  and  development  efforts  at  Al&DS,  we  have  considered  some 
of  the  basic  Issues  that  are  Involved  in  representing  the  types  of  knowledge  that 
must  be  held  by  a  node.  The  design  conclusion  that  we  have  reached  on  the 
basis  of  this  analysis  Is  simple  to  state.  We  have  determined  that  an  expanded 
frame  representation  language  [13]  Is  best  suited  to  provide  the  representational 
power  and  flexibility  needed  for  modeling  the  static  knowledge  of  a  DSN  node. 
(In  fact  our  use  of  a  frame  representation  Is  even  more  pervasive,  but  we  hold 
further  elaboration  of  this  point  until  later.) 
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A  node’s  knowledge  of  a  type  of  object  (e.g.,  a  particular  type  of  missile)  is 
represented  as  a  structured  combination  of  attributes  and,  optionally,  restrictions 
on  the  values  of  those  attributes  that  may  be  held  by  an  Instance  of  that  object 
type.  Figure  4-1  exemplifies  this  types  of  representation.  In  the  figure  we  see 
that  the  object  category  "Backfire_bomber”  is  Identified  in  terms  of  specific  attri- 
butes  such  as  wingspan,  top  speed,  etc.  Each  of  these  attributes  is  likely  to  have 
a  specific  value  or  a  range  of  values  (expressed  as  a  construct  known  as  a  "con¬ 
straint”)  which  must  be  satisfied  for  any  object  to  count  as  an  instance  of  that 
class.  It  is  also  possible  that  the  value  of  an  attribute  can  be  a  complex  struc¬ 
ture.  For  example,  certain  types  of  aircraft  are  distinguishable  in  terms  of  their 
tail  assembly  configuration.  Thus,  the  frame  representation  could  contain  an 
attribute  called  "Tail_conflguration”  which  is  Itself  another  frame  description 
whose  attributes  are  the  components  of  the  tall  assembly,  their  descriptors,  and 
the  relationships  among  these  components. 

Another  important  aspect  of  a  frame  representation  such  as  the  type  we  are 
considering  here  has  to  do  with  the  notion  of  "inheritance”.  This  refers  to  the 
way  that  the  information  described  in  one  frame  may  be  accessed  as  part  of  the 
description  available  in  another  related  frame.  The  frame  description  of  the 
figure  has  an  attribute  called  ”A_klnd_or  that  relates  this  frame  to  another, 
more  general,  frame  for  the  more  general  class  bombers.  In  that  latter  frame 
there  are  contained  a  number  of  descriptors  such  as  ”Bomb_payload:  greater  than 
0”  which  serve  to  more  generically  define  the  features  of  that  class.  In  Figure  4-1 
that  attribute  has  been  "inherited”  and  has  been  given  a  more  specific  restriction. 

Thus,  the  attributes  of  a  frame  description  determine  the  descriptive  pro¬ 
perties  or  a  particular  class,  and  additionally  can  specify  the  relationship  of  that 
class  to  other  classes.  These  Interclass  relationships  provide  the  basis  for  using 
the  knowledge  represented  in  one  frame  to  augment  the  definition/description 
provided  by  another  frame. 

In  addition  to  representing  objects  such  as  aircraft,  sensors,  ships,  etc.,  the 
representation  language  must  also  depict  a  node's  knowledge  of  events.  In  order 
to  do  this  we  have  borrowed  some  Ideas  from  the  work  of  Schank  and  Ahdson 
[14]  and  combined  them  with  our  frame  based  approach.  In  particular,  an  event 
is  represented  as  a  frame  in  which  the  descriptive  attributes  of  the  event  (if  there 


FRAME:  Backf ire_bomber 

A_Jclnd_of:  Bomber 

Top  speed:  - 

Cruising  speed:  - 

Wingspan:  - 

Length:  - 

Bomb_payload :  - 

Range:  - 

etc. 


Figure  4-1:  A  Frame  Representation  Example 
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are  any)  are  represented  in  the  attribute  value  notation  just  discussed.  In  addi¬ 
tion.  the  event  frame  also  depicts  a  sort  of  "script”  that  portrays  a  set  of  simpler 
events  that  comprise  the  structure  of  this  event.  The  sequencing  relation  among 
the  component  event  such  as  sequential  ordering,  parallel  occurence,  conditional 
occurence,  etc.  are  expressed  In  our  representation  system  by  use  of  a  set  of 
primitives  called  a  "strategy  representation  language”  (SRL). 

P'igure  4-2  is  a  simplified  example  of  an  event  representation.  Note  that  in 
the  script  for  the  event,  exemplified  reference  is  made  to  other  event  representa¬ 
tions  called  ”sensor_not_detectlng"  and  ”sensor_detecting_object".  These  two 
component  events  are  themselves  composites  that  are  described  in  terms  of  sim¬ 
ple  events,  and  so  on  until  a  set  of  basic  "primitive  events”  are  reached  in  various 
event  representations.  This  provides  another  kind  of  relationship  among 
representations,  namely  that  one  event  representation  can  provide  a  “high  level” 
description  of  the  flow  of  an  event  and  yet  the  system  can  break  this  high  level 
description  down  into  a  more  detailed  description  by  tracing  the  subevent 
descriptions.  The  notation  "SEQ"  in  the  figure  is  the  relational  operator  from 
our  SRL  which  represents  that  the  component  events  occur  one  after  the  other. 
The  constraint  Indicates  that  there  is  no  overlap.  Finally,  we  note  that  the 
representation  of  time  is  based  on  time  Intervals  rather  than  point.  The  notation 
"NIL”  In  an  Interval  representation  means  that  a  value  need  not  be  specified  In 
an  Instance.  (The  notion  of  a  time  Interval  assumes  that  the  first  point  does  not 
follow  the  second.) 

The  approach  to  a  representation  of  objects  and  events  Just  sketched  is  a 
potentially  quite  powerful  one.  It  borrows  many  of  its  ideas  from  earlier  work  in 
AI  on  knowledge  representation  with  specific  modifications  and  extensions  that 
we  have  adopted  to  meet  the  needs  of  our  distributed  system  applications. 

There  is  yet  another  type  of  knowledge  that  must  be  represented  in  a  node, 
and  that  is  properly  considered  part  of  the  node’s  static  knowledge.  We  refer  to 
the  procedural  knowledge  held  by  that  node.  That  is,  in  addition  to  knowledge 
in  the  form  of  descriptions  of  the  objects  and  events  that  comprise  the  node’s 
understanding  of  the  task  domain,  the  node  must  also  have  "skills".  In  the 
manner  that  Is  common  to  most  work  on  expert  systems,  we  represent  these  skills 
as  knowledge  in  the  form  of  situation-action  entitles  we  will  call  "knowledge* 
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EVENT:  New_sensor_detection 

A_kind_of :  Observation 
Components:  Set_of: 


Observations_device :  Sensor 

Observor:  Node 


Script: 

Subevents:  Get_of: 
Sub_event_l : 

description:  sensor_not_ 

time_interval  (NIL,  Tl); 
Sub_even  t_2 : 

description:  sensor_dete 
time_interval :  (T2,  NIL) 

Script_program: 

Sub_event_l  SEQ  Sub_event_2 
Constraints: 

TIC  T2 


sensor_not_detec ting 
(NIL,  Tl); 

sensor_de tec  t ing_ob j ec  t 
(T2,  NIL) 


Figure  4-2:  An  Event  Representation  Example 
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sources”  (KSs).  More  specifically,  a  KS  Is  a  representation  of  some  action  that  Is 
to  be  taken  by  the  node  as  a  response  to  the  occurence  of  a  particular  condition, 
that  we  will  call  the  "trigger  condition”  for  the  KS.  There  are  a  wide  variety  of 
ways  to  represent  such  situation-action  entitles.  For  now  the  reader  may  think 
of  a  KS  as  a  kind  of  "lf-then”  rule  In  which  the  trigger  condition  is  the  ”lf  part" 
of  the  rule  and  the  action  Is  specified  by  the  "then  part"  of  the  rule.  (We  will 
modify  this  oversimplified  presentation  In  a  moment.) 

Thus,  a  node's  procedural  knowledge,  represented  as  these  KSs,  represents 
that  node’s  ability  to  take  actions  in  the  domain  and  to  solve  problems  or  make 
decisions.  The  abilities  of  a  DSN  system  node  to  participate  In  performing  opera¬ 
tions  on  the  system's  task  will  be  modeled  by  the  KSs  held  by  that  node.  This 
Includes  the  knowledge  that  thee  node  has  for  reacting  to  Inputs  from  other  sys¬ 
tem  elements  such  as  sensors,  for  using  new  and  old  information  to  make  deci¬ 
sions.  to  combine  Information  from  various  sources  and  pass  a  composite  descrip¬ 
tion  along  to  yet  other  system  elements,  etc. 

Figure  4-3  exemplifies  more  accurately  the  design  of  a  KS.  Note  that  this 
representation  is  also  a  frame  description.  However,  there  are  certain  attributes 
In  this  frame  description  whose  value  are  so-called  "attached  proceures”.  In  a 
KS,  these  attached  procedures  are  executable  code  that  embodies  the  actions  that 
the  KS  will  take  when  executed.  Let  us  discuss  a  little  more  carefully  the  struc¬ 
ture  of  the  KS  representation  and  how  a  KS  Is  executed. 

Recall  from  our  earlier  discussion  that  the  basic  notion  a  KS  embodies  is 
that  of  a  "situation-action”  rule.  The  KS  represents  some  action  that  Is  to  be 
undertaken  under  the  condition  that  a  particular  condition  or  situation  is  true. 
The  situation  Is  represented  by  some  pattern  (i.e.,  frame  description),  or  combi¬ 
nation  of  patterns.  In  the  system’s  knowledge  base.  The  trigger  of  the  KS 
describes  this  pattern.  If  the  trigger  pattern  Is  ever  asserted  In  the  system's 
knowledge  base,  then  the  appropriate  code  Is  handed  to  the  node's  top  level 
interpreter  for  execution.  This  code  is  the  part  of  the  "action"  attribute  called 
"code” . 

There  Is  one  more  detail  to  discuss  regarding  the  execution  of  a  KS.  There 
is  an  attribute  In  the  KS  frame  called  the  "precondition"  which  affects  whether  or 
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KNOWLEDGE_SOURCE_NAME : 

Priority: 

Trigger: 

Precondition: 

Action: 

Description: 

Code: 

Failure_act; 

Description: 

Code: 

Knowledge_space : 


Figure  4-3:  Structure  for  a  Simple  Knowledge  Source 
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not  a  KS  action  is  ever  executed  even  though  it  has  been  triggered.  Specifically, 
when  a  KS  is  ready  to  be  executed  by  the  top  level  interpreter,  the  precondition 
is  checked.  If  it  is  not  true  then  the  code  that  is  executed  is  that  contained  in 
the  "failure_act"  attribute.  This  code  can  represent  a  range  of  capabilltltes  such 
as  test  for  data  needed  by  the  KS  to  perform  its  actions,  checks  to  see  whether 
other  KS  actions  that  are  prerequisite  to  this  KS's  actions  have  been  performed, 
specification  of  how  to  suspend  the  call  to  execute  this  KS  action  and  (optionally) 
how  and  when  to  resume  it  later,  etc.  We  have  heretofore  been  informally 
describing  the  KS  as  a  kind  of  "if-then"  rule.  With  the  addition  of  the  precondi¬ 
tion  and  the  precondition  fallure_act  the  more  proper  description  of  a  KS  is  as  an 
"if-then-else”  type  of  rule. 

There  are  some  additonal  features  of  a  KS  that  need  to  be  discussed.  First, 
both  the  "action"  and  the  "failure_act"  attributes  of  a  KS  contain  another  entry 
besides  the  code.  This  entry  is  called  a  "description".  It  Is  important  to  under¬ 
stand  that  the  code  entry  for  an  "action"  or  ”fallure_act”  is  intended  to  be  exe¬ 
cutable  code.  In  order  for  the  node  to  "know”  about  what  a  particular  KS  does, 
some  symbolic  description  must  be  provided  that  can  be  Interpreted.  For  exam¬ 
ple,  suppose  that  the  node  has  established  a  goal  to  accomplish  some  action. 
Then  that  node  must  be  able  to  examine  its  KSs  to  see  if  the  actions  described 
by  any  of  them  accomplish  the  desired  goal.  Some  goal  seeking  KS  must  read 
the  descriptions  of  other  KSs  until  one  (or  some  combination)  is  found  that 
describe  actions  that  achieve  the  goal.  Suppose  that  some  such  KS  is  found 
whose  action  description  matches  the  goal.  Then  the  next  step  in  goal  seeking  is 
to  try  to  ensure  that  the  trigger  and  precondition  patterns  for  that  KS  are 
asserted.  Therefore,  these  trigger  and  precondition  patterns  now  become 
subgoals;  if  they  can  be  asserted  then  a  chain  of  actions  that  lead  to  the  goal  can 
be  executed.  This  exemplifies  how  goal  directed  inference  !s  achievable  by  a  node 
due  to  the  descriptive  component  of  a  KS. 

Note  next  the  slot  called  "  knowledge_space"  in  the  KS  frame.  This  is 
intended  to  model  the  need  that  certain  procedural  elements  have  for  saving 
Information  between  executions.  For  example,  suppose  that  a  KS  is  Intended  to 
be  a  counter  which  keeps  track  of  the  number  of  occurences  of  some  event  and 
reports  when  some  number  of  occurences  has  taken  place.  One  way  (o  represent 
this  is  with  a  KS  that  Is  triggered  by  occurences  of  that  event  and  which 
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increments  a  local  datum  and  then  "goes  to  sleep”  until  triggered  again.  When 
the  KS  Internal  count  reaches  the  requisite  number  on  some  activation  the  report 
will  be  made. 

The  local  data  space  attribute  of  a  KS  thus  allows  It  to  keep  local  state 
information.  Actually,  the  design  we  have  chosen  also  provides  for  separate  KSs 
to  share  portions  of  their  knowledge_space  with  each  other  (but  without  making 
this  data  globally  accessible).  This  provides  a  fundamental  way  that  procedural 
elements  can  communicate  state  Information  with  each  ther.  There  are  other 
advantages  to  allowing  a  KS  to  have  a  local  data  space.  However,  we  will  defer 
discussing  these  for  a  few  moments. 

The  final  KS  attribute  to  mention  is  the  "priority”.  This  Is  Intended  to  be 
a  very  low  resolution  representation  of  the  importance  that  this  KS  has  when  It  is 
triggered  In  comparison  with  the  other  KSs  in  the  system.  As  we  shall  see  when 
we  discuss  the  top  level  control  structure  for  a  node,  this  priority  Is  really 
intended  to  be  used  as  only  a  very  rough  estimate  of  urgency.  The  actual  way 
that  the  node  orders  triggered  KSs  for  execution  relies  on  other  mechanisms  that 
can  operate  In  a  more  context  specific  way. 

We  have  not  yet  mentioned  one  very  Important  aspect  of  the  KS  represen¬ 
tation  used  In  our  system.  We  ha.ve  restricted  the  discussion  of  a  KS  action  to 
being  a  single  piece  of  code  that  is  directly  executed  when  the  KS  is  triggered.  It 
is  also  possible  for  a  KS  to  be  a  representation  of  a  composite  action  by  making 
use  of  the  local  knowledge_space  in  a  KS  and  the  script  language  we  discussed  In 
our  consideration  of  event  representations.  In  the  case  of  a  composite  KS,  the 
code  (for  either  the  action  or  the  failure_act)  can  be  a  simple  action  that  executes 
an  entire  group  of  actions  In  some  order.  The  representation  of  these  actions  Is 
located  In  the  KS’s  knowledge_space.  These  actions  are  organized  in  a  control 
structure  In  terms  of  the  strategy  representation  language  (SRL)  discussed  earlier. 
Thus,  the  code  acts  like  a  local  interpreter  of  a  script  for  composite  action. 

Let  us  summarize  the  basic  features  of  a  KS  as  a  model  of  procedural 
knowledge.  It  Is  an  if-then-else  construct  which  provides  for  Important  capabili¬ 
ties  such  as  synchronization,  type  checking,  etc.  to  be  experssed.  It  provides  for 
event  directed  execution  by  Its  trigger-action  basic  structure,  and  for  goal 


4-14 


directed  execution  by  having  descriptions  of  the  outcome  of  Its  execution.  This 
type  of  model  for  a  procedural  element  in  a  system  gives  generality  to  the  kinds 
of  inference  that  a  system  can  do  using  this  KS  structure  as  the  format  for 
expressing  Its  procedural  knowledge.  Finally,  the  KS  provides  for  local  data 
storage  so  that  both  computational  and  data  state  can  be  saved  between  execu¬ 
tions.  One  very  Important  way  that  this  local  data  space  construct  is  used  is  In 
the  representation  of  composite  KS  actions.  In  this  case  the  script  for  a  compo¬ 
site  action  is  found  in  the  KS's  knowiedge_space  and  the  code  is  an  interpreter 
that  executes  this  script.  Thus,  the  KS  model  we  have  chosen  is  also  sufficiently 
general  to  represent  very  powerful  computational  constructs  such  as  object- 
oriented  code  [15]. 

We  have  now  discussed  the  basic  concepts  used  in  the  design  of  a  node  for 
representing  static  knowledge.  Let  us  summarize  this  discussion.  A  node's  static 
knowledge  is  represented  In  a  frame  description  language  that  portrays  a  concept 
as  a  structured  representation  of  attributes  and  the  values  or  ranges  of  values 
that  each  attribute  may  have  in  any  Instance  of  the  concept.  In  addition,  events 
are  represented  as  frames  which  contain  a  script  depicting  the  ordering  of  simpler 
events  In  addition  to  the  descriptive  attribtes  of  the  event  representation. 
Finally,  KSs  are  represented  as  frames  with  attached  code  that  may  be  executed 
to  enact  the  procedural  knowledge  that  the  KS  represents.  KSs  may  be  simple, 
meaning  that  the  action  to  be  carried  out  is  one  unlnterruptable  activity,  or  they 
may  be  composite.  In  a  composite  KS  the  code  Is  a  (usually  trivial)  interpreter 
that  executes  a  set  of  actions  described  in  the  KS’s  local  know'!edge_space  by  a 
script 


4. 2- 1.2  Situational  knowledge 

Now  we  should  consider  the  node’s  representation  of  situational  knowledge. 
This  type  of  knowledge  refers  to  the  node's  hypotheses  regarding  the  existence  of 
objects,  events,  constraints,  goals  to  be  met,  etc.  in  the  task  context.  One  toch- 
niciuc  we  have  devised  Tor  representing  such  hypotheses  is  depleted  in  Figure  1-1. 

In  that  figure  one  may  see  that  each  hypothesis  Is  represented  as  some  pat¬ 
tern  of  underlying  assertions  or  observations.  One  may  think  of  this  as  a 
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CONTEXT 

r 


1 i :  2  TARGETS  DETECTED  e,:  OBSERVATIONS  IN  SET 

A  FROM  SAME  TARGET 

e*:  OBSERVATIONS  IN  SET 
B  FROM  SAME  TARGET 


Figure  Format,  for  Hypothesis  Representation 
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represetatlon  In  which  the  hypothesis  Is  a  claim  that  some  compound  event  has 
occured  (or  Is  occurlng),  and  the  underlying  observatons  are  the  evidence  that 
supports  the  hypothesis.  The  individual  pieces  of  evidence  may  simultaneously 
support  more  than  one  hyothesls.  Each  piece  of  evidence  can  have  some  value 
attached  to  it  that  represents  the  plausibility  of  that  piece  of  evidence,  and  the 
association  of  a  piece  of  evidence  to  the  hypothesis  is  weighted.  The  plausibility 
of  the  overall  hypothesis  is  a  function  of  the  plausibilities  of  the  supporting  evi¬ 
dence  modulo  the  weight  of  association  for  each  piece.  Finally,  hypotheses  are 
organized  in  clusters  that  represent  mutually  competing  hypotheses  for  interpret¬ 
ing  a  set  of  observations  or  other  assertions.  In  this  way  groups  of  hypotheses 
that  represent  conjectures  about  unrelated  sets  of  data  are  partitioned  from  each 
other  so  as  to  simplify  the  process  of  hypothesis  management.  The  techniques  of 
hypothesis  representation  and  management  have  been  discussed  in  the  report  [I], 

Figure  4-5  outlines  the  essentia'  notions  that  enter  into  the  process  of 
hypothesis  management.  For  the  most  part  the  notions  presented  there  are  quite 
obvious.  However,  there  are  actually  a  number  of  alternative  methods  for  accom¬ 
plishing  many  of  these  functions.  For  example,  the  task  of  propagating  the  plau¬ 
sibility  of  supporting  evidence  to  the  plausibility  of  the  hypothesis  that  it  sup¬ 
ports  may  be  handled  in  a  variety  of  ways  (e.g.,  using  a  Bayesian  approach, 
Dempster-Schaffer  theory,  fuzzy  logic,  etc.).  In  turn,  the  pruning  rule  for  elim¬ 
inating  hypostheses  when  their  plausibility  falls  too  low  may  be  one  of  a  large 
number  of  alternatives.  We  have  not  yet  determined  which,  if  any,  of  the  alter¬ 
native  computational  theories  for  combining  evidence  is  the  best;  however,  the 
representational  calculus  exemplified  in  figure  4-4  provides  a  structure  within 
which  any  of  these  alternatives  can  be  applied. 


4. 2. 1.3  Planning  knowledge 

'Phe  next  issue  to  be  discussed  in  the  representation  of  a  DSN  system  node's 
knowledge  has  to  do  with  the  potential  need  for  a  node  to  engage  in  planning, 
such  as  resource  allocation,  adaption,  etc.  Although  it  will  not  be  a  requirement, 
for  all  nodes  to  have  planning  ability,  we  nevertheless  must  provide  this  capapbil- 
itly  if  we  are  to  use  one  general  model  of  a  DSN  system  element  as  a  template 
with  which  to  model  the  various  individual  system  elements,  some  of  which  will 
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HYPOTHESIS  MANAGEMENT 


•  PRUNING 

—  ELIMINATING  LOW  CONFIDENCE  HYPOTHESES 
—  SETTING  ADAPTIVE  THRESHOLDS 

•  COMBINING 

—  REPLACING  SIMILAR  HYPOTHESES  BY  ONE 
HYPOTHESIS 

•  CLUSTERING 


—  PARTITIONING  HYPOTHESIS  SPACE 
-  NO  POSSIBLE  CROSS  ASSOCIATIONS 
•  RECOVERING 

—  ELIMINATE  HYPOTHESES  GENERATED  BY 
NOISE 


Figure  4-5:  Hypothesis  Management  Actions 
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indeed  be  capable  of  planning. 


Actually,  the  planning  capability  of  a  node  is  representable  in  terms  of 
three  constructs  that  we  have  already  introduced.  The  first  of  these  is  the 
representation  of  events,  which  a  node  may  use  to  represent  goals  that  are  to  be 
achieved.  The  second  is  the  SRL  used  to  describe  the  ordering  of  activity  in 
composite  events  and  in  composite  actions.  These  two  devices  provide  the  means 
to  a  node  to  represent  plans  for  a  series  of  actions  to  achieve  goals.  The  third 
mechanism  is  to  provide  a  node  with  a  specific  set  of  "planning”  KSs.  These  KSs 
will  include  KSs  to  post  goals  to  be  achieved,  KSs  to  divide  goals  into  groups  of 
subgoals,  KSs  to  construct  action  scripts  to  achieve  goals  or  subgoals,  KSs  to  exe¬ 
cute  a  plan  once  constructed,  KSs  to  monitor  plan  execution  so  as  to  provide  for 
replanning  capability  when  conditions  that  were  part  of  the  assumptions  of  a 
plan  have  changed,  etc. 


4. 2. 1.4  Control  knowledge 

The  last  major  type  of  knowledge  that  we  promised  to  discuss  Is  so-called 
control  knowledge.  This  refers  to  the  knowledge  that  the  node  has  for  how  to 
organize  the  actions  that  it  must  undertake.  If  we  are  to  model  nodes  In  a  DSN 
system  that  are  Intelligent  we  must  provide  for  a  control  structure  that  Is  flexible 
and  context  sensitive.  Thus,  in  addition  to  providing  KSs  in  a  node  model  that 
can  carry  out  actions  In  the  task  domain,  we  also  need  to  provide  the  node  with 
KSs  that  can  resolve  conflicts  If  more  than  one  KS  is  relevant  to  a  situation  and 
KSs  that  are  able  to  alter  the  queue  of  pending  actions  that  that  node  must  exe¬ 
cute  in  response  to  a  sudden  change  of  conditions.  The  approach  we  take  to  this 
is  to  apply  the  planning  capability  Just  discussed  to  the  control  of  the  node  own 
computational  processes.  Thus,  our  approach  to  control  is  to  view  it  as  a  plan¬ 
ning  and  problem  solving  domain  for  which  we  supply  a  set  of  control  KSs  that 
arc  triggered  by  the  structure  of  actions  that  are  pending  and  that  are  ongoing  in 
that  node.  This  approach  Is  an  alternative  to  providing  a  single  complex  control 
structure  at  the  top  level  In  a  node. 
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Of  course,  the  topic  of  control  raises  the  Issue  of  the  general  framework  for 
top  level  control  that  Is  to  be  provided  for  a  DSN  node  representation.  Figure  4-6 
depicts  this  framework.  The  general  structure  of  the  architecture  is  divided  Into 
the  two  components  of  the  CONTROLLER  and  the  BLACKBOARD.  This  archi¬ 
tecture  Is  an  intellectual  descendant  of  the  type  of  expert  system  known  as  a 
blackboard  architecture  (16).  In  representing  a  DSN  node  in  this  way,  the 
entirety  of  the  node’s  knowledge  Is  stored  on  that  node’s  blackboard.  As  Is 
shown  In  the  figure,  this  includes  an  area  for  the  static  knowledge  held  by  the 
node  as  well  as  an  area  for  the  node's  hypotheses.  Specifically,  the  blackboard 
contains  the  representations  of  the  node’s  KSs  that  represent  the  actions  that 
that  node  Is  able  to  perform.  Finally,  there  is  an  area  (shown  at  the  top  of  the 
blackboard)  that  represents  the  node’s  notation  about  its  current  state  of  execu¬ 
tion,  called  the  AGENDA  SPACE.  In  this  latter  area  is  a  representation,  called 
the  AGENDA,  of  the  set  of  KSs  that  have  already  been  triggered  but  have  not 
yet  been  executed  by  the  CONTROLLER.  There  is  also  In  this  space  a  HIS¬ 
TORY  structure  which  is  a  kind  of  audit  trail  of  KSs  executions  that  have 
already  occured. 

The  other  major  component  of  the  framework  is  the  CONTROLLER.  This 
is  the  algorithm  that  controls  the  general  execution  of  the  node  model.  It  is 
divided  into  four  stages.  These  are  the  INTERPRETER,  the  BLACKBOARD 
MANAGER,  the  EVENT  DETECTOR,  and  the  PRIORITIZER.  The  basic  loop 
repeated  by  this  CONTROLLER  is  essentially  the  following. 

First,  it  Is  the  responsibility  of  the  INTERPRETER  to  select  the  first  KS 
on  the  agenda,  check  the  KS  precondition,  and  execute  the  action  or  the  failure 
action  for  that  KS.  Then  the  BLACKBOARD  MANAGER  filters  the  output  of 
the  code  run  by  the  INTERPRETER  and  posts  any  changes  to  the  BLACK¬ 
BOARD  that  have  been  created.  Next  the  EVENT  DETECTOR  checks  the  con¬ 
tents  of  the  blackboard  to  see  If  there  Is  a  pattern  of  assertions  which  match  the 
trigger  pattern  for  any  KS.  The  list  of  KSs  that  are  triggered  arc  passed  up  to 
the  PRIORITIZER  which  Inserts  the  newly  triggered  KSs  into  the  remaining 
AGENDA,  ordering  them  on  the  basis  of  their  priority.  The  KS  that  was  at.  the 
front  of  the  list  of  the  AGENDA  is  removed  and  is  added  to  the 
HISTORY_LIST.  Then  the  cycle  Is  repeated  again. 
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•  MIXED  INITIATIVE  PLANNING/REPLANNING  SUPPORTED 
—  HIERARCHICAL  PLANNING  CAPABILITY 

—  OPPORTUNISTIC  PLANNING/REPLANNING  POSSIBLE 

•  COMBINES  ANALYTIC  (E.G.  BAYESIAN)  AND  HEURISTIC  APPROACHES 
TO  EVIDENTIAL  REASONING 

•  REAL  TIME  APPLICATIONS  FEASIBLE 

—  SPEED  DUE  TO  COMPILED  FORM  OF  PROCEDURAL  KNOWLEDGE 
PLUS  A  FAST  TRIGGERING  MECHANISM 

—  AGILITY  DUE  TO  USE  OF  CONTROL  KNOWLEDGE  SOURCES  'TO 
SHIFT  ACTIVITY  FROM  ONE  PATH  TO  ANOTHER 

•  OVERALL  ARCHITECTURE  PROVIDES  A  SYSTEM  DEVELOPMENT 
ENVIRONMENT  FOR  RAPID  CONSTRUCTION  AND  PROTOYPING 


Figure  -1-0:  Architecture  for  a  DSN  Node 
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There  are  a  number  of  efficiencies  that  we  have  Included  In  the  actual 
design  Just  sketched.  First,  note  that  the  way  the  INTERPRETER  executes  a 
KS  action  requires  only  that  the  code  for  that  action  be  passed  off  to  the  underly¬ 
ing  cpu  of  the  system  in  which  this  system  is  implemented.  That  is,  when  a  KS 
code  Is  executed  the  INTERPRETER  Is  not  performing  translation  from  a  sym¬ 
bolic  sturcture  to  an  executable  one.  The  executable  structure  Is  already  present 
in  the  code  attribute  of  the  KS,  and  the  INTERPRETER  merely  passes  this  exe¬ 
cutable  structure  on  to  the  underlying  system  as  a  process.  In  addition,  the  step 
of  determining  what  new  KSs  have  been  triggered  is  embodied  In  an  algorithm 
that  we  have  developed  that  involves  almost  no  search.  Thus,  triggering  Is  very 
fast  (and  In  fact,  our  algorithm  provides  for  triggering  on  deletions  as  well  as 
additions  to  the  blackboard  and  for  use  of  full  generalizations  In  the  trigger  pat¬ 
terns  that  may  be  used). 

In  the  discussion  of  knowledge  representation  above  we  pointed  out  how  a 
composite  KS  can  represent  a  complex  algorithm.  Coupled  with  the  top  level 
architecture  Just  sketched,  this  provides  an  architectural  template  that  can  be 
used  to  model  a  simple  fixed  control  system  as  easily  as  we  may  use  this 
approach  to  model  a  complex.  Intelligent  node.  A  simple  node  can  be  represented 
by  a  model  with  only  one  KS  in  which  the  code  for  that  KS  Is  the  fixed  algorithm 
that  the  node  performs.  (Note  that  there  Is  almost  no  overhead  to  pay  In  using 
the  CONTROLLER  to  run  that  KS.)  The  blackboard  for  that  simple  node 
would  probably  contain  very  little  additional  knowledge.  On  the  other  hand,  a 
complex  Intelligent  agent  could  be  modeled  by  a  version  of  this  template  contain¬ 
ing  knowledge  representations  of  all  the  types  discussed  above,  including  a 
number  of  simple  and  composite  KSs  representing  the  decision  making  and  prob¬ 
lem  solving  abilities  of  that  Intelligent  node.  We  have  used  this  facility  In  a 
Schemer  application  In  which  we  constructed  a  distributed  computation  system 
with  distributed  performance  management  and  performance  diagnosis  abilities 
[10]. 


This  completes  the  discussion  of  the  features  provided  in  our  testbed  design 
that  are  to  be  used  for  modeling  a  participant,  a  node,  in  a  DSN  system.  The 
DSN  system  designer  Is  provided  with  techniques  for  modeling  the  capabilities  of 
even  Intelligent  participants  In  a  DSN  system  by  being  provided  with  the  expert 
system  framework  depicted  in  figure  1-5,  plus  the  representation  language  for 
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describing  that  node's  knowledge  of  objects,  events,  rules  and  other  procedures, 
as  well  as  hypotheses  about  the  task  context  and  techniques  (i.e.,  KSs)  for 
managing  these  hypotheses.  We  again  should  note  that,  although  the  modeling 
facilities  just  described  arc  especially  intended  for  the  modeling  of  intelligent 
DSN  system  elements,  these  facilities  are  quite  well  suited  for  modeling  simpler 
elements  of  a  DSN  system.  In  particular,  the  minimal  amount  of  structure  pro¬ 
vided  in  the  top  level  controller  for  a  node  model  minimizes  the  computational 
overhead,  and  the  computation  modeling  assumptions,  that  are  implicit  in  the 
use  of  the  exert  system  framework  Just  described  as  a  model  of  a  DSN  system  ele¬ 
ment. 

4.2.2  Node  relations  in  the  DSN  system 

Now  we  must  consider  how  the  designer  of  the  DSN  system  Is  to  model  the 
relationships  that  obtain  among  the  elements  of  the  DSN  system  and  the  opera¬ 
tional  context  within  which  the  system  is  to  perform  its  functions.  The  basic 
concept  for  how  we  propose  to  accomplish  this  is  really  quite  simple.  First,  we 
need  to  provide  a  modeling  framwork  within  which  the  models  of  the  various 
nodes,  constructed  as  discussed  above,  can  be  embedded.  It  is  within  this  larger 
modeling  context  that  the  relations  among  nodes  and  the  characteristics  of  the 
task  domain  are  to  be  modeled.  Second,  within  this  larger  modeling  context  the 
relations  among  the  system  nodes  and  the  objects  and  events  of  the  task  domain 
will  be  represented. 

Lot  us  review  the  critical  relations  among  system  nodes  that  must  be 
modeled.  There  are  two  fundamental  types  of  internode  relations  that  must  lie 
represented  In  a  DSN  system  design,  the  modeling  of  the  communications  rela¬ 
tions  among  the  DSN  system  nodes  and  the  modeling  or  tiio  control  or  authority 
relations  that  obtain  among  the  system  elements. 

The  modeling  of  communication  relations  among  nodes  involves  the  follow¬ 
ing  basic  notions.  Suppose,  for  example,  that  we  wish  to  model  a  specific  com¬ 
munication  between  two  nodes,  say  Node_A  and  Node_B.  Haeh  of  these  nodes 
is.  of  course,  represented  by  a  structure  like  that  or  figure  t-M.  A  communication 
from  \odc_A  to  Node_H  can  be  modeled  as  an  output  of  some  action  of  tip-  Mrs! 
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node  that  Is  represented  In  the  larger  modeling  framework  In  which  the  two  node 
models  are  embedded.  This  communications  output  from  the  first  node  can  serve 
as  Input  to  a  structure  that  models  the  communications  medium  through  which 
the  message  from  Node_A  travels.  The  message  Is  processed  by  the  communica¬ 
tions  medium  model  whose  output  Is  the  input  to  Node_B's  message  receiving 
procedures. 

The  communications  medium  model  will  be  constructed  so  as  to  model 
some  specific  mechanism  for  dealing  with  a  particular  type  of  message  transmis¬ 
sion  such  as,  for  example,  a  packet  radio  network.  The  model  of  such  a  commun¬ 
ications  medium  can  be  constructed  using  the  same  approach  as  that  used  to 
model  a  system  node.  This  model  of  a  communications  medium  will  contain  pro¬ 
cedural  elements  (KSs)  that  represent  operations  of  the  communication  medium 
in  receiving  a  message,  processing  it,  and  then  passing  It  on.  In  addition,  the 
communications  medium  model  can  also  include  KSs  and  other  elements  that 
represent  the  effects  of  noise  or  other  perturbations  on  the  message  passing  pro¬ 
cess.  Finally,  the  communications  medium  model  passes  on  the  results  of  its  pro¬ 
cessing  to  the  receiving  node  by  producing  output  in  a  form  that  represents 
proper  Input  for  the  message  receiving  KSs  of  the  Intended  recipient  node.  (This 
is,  of  course,  only  true  provided  that  the  message  has  not  been  "blocked"  in  its 
transmission  as  a  result  of  processes  of  noise  or  other  interference  being  modeled). 

This  approach  to  modeling  the  communications  that  occur  among  DSN  sys¬ 
tem  elements  requires  no  general  modeling  facilities  beyond  those  already  pro¬ 
vided  for  modeling  the  decision  making  elements  of  the  DSN  system.  It  has  the 
advantage  of  providing  the  system  designer  a  way  to  independently  model  the 
four  primary  components  of  Internode  communications  These  are;  message  com¬ 
position  and  sending,  message  transmission,  transmission  interference,  and  mes¬ 
sage  reception  and  interpretation.  Using  tills  approach  it  is  possible  to  mode)  in 
great  detail  a  variety  of  communications  methods  lining  simultaneously  used  in  a 
DSN  system. 

The  other  fundamental  Internode  relation  to  discuss  here  is  that  of  control 
or  authority  relations  among  system  nodes.  The  modeling  techniques  Just 
described  for  deplcltlng  communications  relations  can  be  extended  slightly  to 
handle  this  modeling  chore.  In  other  words,  control  by  one  node  over  the  actions 
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of  another  may  be  modeled  as  a  type  of  communication  plus  "rules"  held  by  each 
node  regarding  the  bounds  of  authority.  In  particular,  a  "command”  from  one 
node  to  another  can  be  a  communication  that,  when  processed  as  Input  by  the 
second  node.  Is  the  trigger  condition  for  some  specific  action  (KS)  of  the  recipient 
node. 


4.2.3  Task  context  modeling  and  simulation 

Let  us  now  consider  how  we  may  use  the  same  modeling  approach  just 
described  to  model  the  task  environment  in  which  the  DSN  system  will  operate. 
By  now  the  reader  should  be  able  to  anticipate  the  gist  of  this  discussion.  The 
functional  elements  of  the  task  domain  are  modelable  by  the  same  means  that 
are  used  to  model  the  DSN  system  nodes.  That  Is,  each  functional  element  is  a 
modeled  as  a  structure  that  produces  output  representing  the  effects  of  that  ele¬ 
ment  on  the  DSN  system  and  on  other  elements  of  the  task  context.  For  exam¬ 
ple.  suppose  that  the  DSN  system  Is  engaged  In  a  task  of  using  sensors  to  watch 
the  activity  of  vehicles  along  a  road  network.  Consider  a  model  of  a  specific 
object  that  Is  "moving”  along  a  particular  road.  This  object  movement  can  be 
represented  by  a  computational  element  that  produces  as  output  an  update  of  its 
position  over  time.  This  output  can  be  used  as  Input  by  a  particular  sensor 
model  that  is  constructed  so  as  to  be  able  to  "observe”  objects  In  an  area  occu¬ 
pied  by  the  vehicle  (model).  This  Input  to  the  sensor  can.  In  turn,  cause  that 
model  to  produce  an  output  (say,  in  the  form  of  a  commmunlcation)  that,  is 
taken  as  input  by  one  or  more  nodes  which  process  Information  from  this  particu¬ 
lar  sensor.  Thus,  the  model  of  the  vehicle  has  caused  a  chain  of  activity  that  cul¬ 
minate?  in  some  set  of  decision  making  nodes  of  the  DSN  system  in  being  called 
to  respond  to  that  domain  object's  activity. 

In  general  then,  each  functional  object  In  the  task  environment  can  be 
modeled  by  an  Instantiation  of  the  architectural  framework  of  Figure  4-6  contain¬ 
ing  data  and  other  procedures  specific  to  the  functional  properties  of  that  object. 
The  actions  of  this  object  produce  outputs  that  are  suitable  inputs  to  specific 
DSN  system  components  that  are  Intended  to  "perceive”  and  respond  to  that 
object's  activity.  This  modeling  of  cause  and  effect  Is  very  similar  to  the  way  in 
which  communication  relations  among  DSN  system  nodes  are  to  be  modeled. 
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The  general  testbed  environment  will,  therefore,  be  required  to  provide  a  context 
for  representation  in  which  the  specific  models  of  the  DSN  system  nodes,  the 
communications  media,  and  the  task  environment’s  functional  entities  can  all  be 
modeled.  The  activities  of  all  these  models  are  recorded  in  the  testbed’s  data 
base  as  outputs  such  that  each  output  can  be  discerned  by  all  and  only  those 
models  that  are  intended  to  be  able  to  react  to  the  activity  represented  by  that 
output.  The  testbed  data  base  holding  the  representations  of  all  these  actions  of 
system  and  context  elements,  must  be  organized  so  that  the  output  from  any  par¬ 
ticular  element  will  qualify  as  an  input  for  only  those  other  elements  that  are 
appropriate. 


4.3  AN  ARCHITECURE  FOR  THE  DESIGN  TESTBED 

In  the  preceding  discussion  we  have  presented  some  ideas  on  how  to  model 
the  elements  of  a  DSN  system.  The  modeling  approach  we  have  offered  is  to  use 
a  generalized  expert  system  architecture  as  the  basic  ’’template"  for  designing  a 
node  in  a  DSN  system.  In  addition,  we  have  suggested  that  this  same  set  of  tech¬ 
niques  can  be  used  for  representing  the  functonal  elements  of  the  task  domain  as 
well  as  for  depicting  the  command  and  communication  relations  that  obtain 
among  the  DSN  nodes.  We  have  not  yet  dealt  with  how  a  design  environment 
might  be  provided  as  the  framework  within  which  to  do  this  design  construction, 
rapid  prototyping,  and  evaluation. 

We  will  now  present  an  architecture  that  provides  a  context  for  the 
development  of  the  types  of  structures  just  discussed  along  with  facilities  for 
using  these  structures  to  simulate  the  performance  of  the  DSN  system  they  arc 
Intended  to  model.  Since  the  approach  we  have  proposed  relies  upon  an  Implicit 
analogy  between  expert  system  construction  and  DSN  system  design,  we  will  offer 
as  our  general  solution  a  framework  that  is  essentially  an  expanded  version  of  an 
expert  system  building  environment.  We  present  the  design  of  an  AI  architecture 
for  expert  system  construction  called  Schemer  as  the  basis  of  a  testbed  environ¬ 
ment  in  which  to  construct,  evaluate,  and  run  simulations  of  a  DSN  design.  The 
basic  ideas  in  Schemer  are  ones  that  we  have  had  a  great  deal  of  experience  with, 
having  used  a  simpler  version  of  this  system  than  that  presented  here  as  an 
expert  system  development  environment  for  construction  of  a  number  of  expert 
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system  applications.  However,  in  order  to  deal  with  the  problem  of  modeling  a 
distributed  system,  and  a  system  in  which  many  of  the  elements  are  themselves 
intelligent,  decision  making  agents,  we  have  found  It  necessary  to  greatly  extend 
our  original  ideas. 

The  basic  idea  behind  Schemer  is  to  provide  a  computational  environment 
in  which  an  expert  system  designer  can  incrementally  build  his  application  by 
specifying  the  components  of  his  system  Including  the  representation  of  objects 
that  must  be  known  to  the  expert  system,  and  the  procedural  rules  that  define 
the  system's  capabilities  for  taking  actions  to  carry  out  its  intended  tasks.  Thus, 
the  expert  system  development  framework  must  provide  the  developer  with  a 
knowledge  representation  language  to  encode  the  expert  system's  knowledge  of 
essential  objects  and  events  in  the  task  domain  and  a  general  format  for  express¬ 
ing  the  procedural  elements  of  the  expert  system,  its  knowledge  sources. 

To  provide  this  representational  support  Schemer  is  equipped  with  a  gen¬ 
eral  frame  representation  language  for  expressing  such  knowledge,  and  a  special 
format  for  representing  procedural  knowledge.  Not  surprisingly,  the  approach  we 
have  chosen  for  knowledge  representation  has  already  been  discussed  In  the  previ¬ 
ous  section.  The  representation  language  approach  discussed  there  for  represent¬ 
ing  the  knowledge  of  a  DSN  system  node  Is  precisely  the  type  of  language  that 
we  have  used  In  Schemer,  and  the  KS  definition  of  Figure  4-3  is  exactly  the  for¬ 
mat  used  for  representing  the  procedural  elements  of  an  expert  system  within  the 
Schemer  development  environment. 

In  addition  to  constructing  the  elements  of  his  expert  system  using  the 
representational  facilities  Just  described,  the  developer  must  be  able  to  run  early 
versions  of  his  system  on  test  problems  to  determine  whether  the  design  to  that 
point  is  achieving  expected  behavior.  Similar  to  the  Ideas  in  the  previous  section 
we  found  that  the  basic  representation  facilities  for  constructing  the  expert  sys¬ 
tem  Itself  could  also  be  profitably  used  to  build  a  kind  of  simulation  environment 
O.o..  a  set  of  test  cases)  against  which  various  versions  of  the  syst  em  design  could 
be  tested.  In  fact,  our  approach  to  providing  a  simulation  based,  rapid  prototyp¬ 
ing  environment  Is  motivated  by  the  experience  that  we  have  tad  in  using  the 
modeling  capabilities  of  our  expert  system  development  environment  to  construct 
models  of  task  situations  against  which  that  system  could  be  tested.  This  also 


4-27 


means,  of  course,  that  the  combined  expert  system  model  and  task  domain  model 
would  need  to  be  able  to  be  put  In  a  form  that  could  be  executed.  Hence,  Sche¬ 
mer  was  required  to  be  a  context  for  controlling  the  execution  of  such  design  pro¬ 
totypes  In  the  context  of  specific  models  of  the  task  domain. 

Figure  4-7  depicts  the  way  that  we  designed  Schemer  to  provide  this  sup¬ 
port  for  both  expert  system  design  and  prototyping.  Essentially,  the  Idea  we  pur¬ 
sued  was  to  take  the  basic  blackboard  architecture  for  representing  an  expert  sys¬ 
tem  such  as  the  type  shown  In  Figure  4-8,  and  then  to  add  some  addltonal  levels 
of  control  to  the  architecture  to  support  design  construction,  scenario  context 
construction,  and  control  of  execution  of  the  expert  system  on  the  model  of  the 
task  domain.  The  structure  of  the  blackboard  In  the  figure  Is  divided  (for  pur¬ 
poses  of  presentation)  into  a  left  half  on  which  various  levels  of  knowledge 
representations  are  written,  and  right  half  on  which  the  procedural  KSs  are 
stored.  Vertically  we  have  depicted  four  basic  levels  of  representation.  At  the 
lowest  level  there  are  the  knowledge  representation  structures  and  the  KSs  of  the 
expert  system  model  Itself.  This  level  Is  the  part  constructed  by  the  developer 
that  will  eventually  stand  alone  as  the  expert  system  application.  Above  this 
level  Is  the  representation  of  the  simulation  environment  for  testing  the  expert 
system  design.  For  the  most  part  the  task  model  Is  represented  by  KSs  that  pro¬ 
vide  simulated  events  as  Input  to  the  expert  system  KSs.  These  task  domln  KSs 
do  this  by  posting  their  output  on  the  part  of  the  board  labeled  "Task  Domain 
Event  Reps."  These  event  representations  serve  as  triggers  for  the  expert  system 
KSs  at  the  level  below.  This  approach  provides  a  way  of  simulating  the  Interac¬ 
tion  between  the  expert  system  and  events  in  the  task  domain. 

The  upper  two  levels  of  the  blackboard  in  figure  4-7  represent  the  way  we 
have  provided  automated  tools  In  the  original  Schemer  development  environment. 
The  third  level  from  the  bottom  represents  the  presence  of  some  evaluation  tools, 
encoded  as  KSs,  and  the  representation  of  the  results  of  evaluation  on  the  left. 
The  level  immediately  above  this  Is  the  set  of  KSs  that  can  be  used  to  control  the 
use  of  the  system  for  various  activities.  For  example,  control  KSs  at  this  level 
can  take  the  elements  of  a  scenario  and  cause  the  domain  model  to  post  events  of 
activity  that.  In  turn,  trigger  the  actions  of  the  expert  system  In  response.  Also, 
we  have  used  control  KSs  at  this  level  to  trigger  special  analyses  to  be  performed 
on  the  expert  system's  activities  upon  detection  of  a  particular  event,  that  has 
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Figure  4-7:  Basic  Schemer  Architecture  for  DSN  Design 
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occured  during  execution  of  the  simulation.  Other  forms  of  these  control  KSs 
that  we  have  used  Include  a  KS  that  effectively  "single  steps"  the  execution  of 
the  expert  system  being  evaluated  and  control  KSs  for  displaying  the  data  struc¬ 
tures  that  "cause”  triggering  of  the  expert  system  KSs  as  these  occur. 

The  top  level  control  structure  of  the  Schemer  architecture  is  essentially  the 
same  as  that  we  have  described  in  the  previous  section.  User  interaction  with  the 
development  environment  is  accomplished  by  having  user  post  input  events  on 
the  control  blackboard  which  trigger  appropriate  actions  by  Schemer.  Thus,  this 
system  can  be  operated  Interactively  as  well  as  in  the  fully  automated  manner 
that  is  assumed  for  this  general  type  of  architecture. 

There  remain  a  number  of  llmlta’ions  to  the  current  version  of  Schemer  as 
a  DSN  development  environment.  First,  little  or  no  work  has  been  done  on  the 
development  of  explicit  evaluation  tools  beyond  those  tools  to  support  the  empiri¬ 
cal  observation  and  summarization  of  the  expert  system’s  performance  on  specific 
scenarios.  Second,  nothing  is  provided  in  the  way  of  "library"  facilities  that  con¬ 
tain  frequently  used  control  and  structures  that  can  be  employed  for  a  specific 
application  [17].  Third,  and  perhaps  most  important,  the  expert  system  pro¬ 
cedural  components  that  can  be  modeled  in  the  original  version  of  Schemer  arc 
either  simple  condition- action  rules  or  composite  rules  in  which  the  action  part  is 
some  algorithm  for  combining  simpler  actions.  There  is  no  provision  made  in  this 
earlier  version  of  Schemer  for  allowing  a  KS  to  be  an  entire  expert  system  archi¬ 
tecture  of  its  own  as  we  discussed  In  the  previous  section.  Finally,  we  have  yet 
to  integrate  non-AI  algorithms  and  systems  such  as  GTC  into  a  particular  Sche¬ 
mer  application. 

In  Section  4.2  we  discussed  a  set  of  representation  and  modeling  techniques 
that  we  believe  explicitly  address  the  requirements  of  a  DSN  design  testbed.  In 
addition  to  these  facilities  we  are  condsldering  some  additional  extensions  to  the 
previous  version  of  the  Schemer  architecture.  Along  with  the  analysis  of  represen¬ 
tation  from  section  4.2  we  have  devised  the  changes  depicted  in  Figures  1-8  and 
4-9  to  address  the  limitations  of  the  original  Schemer  development  environment 
for  use  as  a  DSN  system  testbed. 
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In  Figure  4-8  we  see  five  levels  of  the  testbed  blackboard.  The  lowest  level 
corresponds  to  the  modeling  of  the  DSN  system  and  the  task  context  of  that  sys¬ 
tem.  The  level  above  that  Is  used  for  knowledge  about  the  state  of  the  simula¬ 
tion  (on  the  left  of  the  diagram)  and  KSs  that  are  used  to  control  the  execution 
of  a  simulation  from  a  script  or  other  description  of  that  scenario  provided  In  the 
space  to  the  left.  These  areas  generally  correspond  to  facilities  that  were  also 
available  in  the  earlier  Schemer  design,  although  the  system  facilities  for  simula¬ 
tion  control  are  now  separate  from  those  for  design.  The  third  level  from  the 
bottom  of  the  figure  refers  to  tools  for,  and  knowledge  about,  evaluation  of  a  test 
of  a  design  on  a  scenario.  In  other  sections  of  this  report  we  have  discussed  tech¬ 
niques  for  evaluating  some  portion  of  a  design  analytically.  Certainly  these  tech¬ 
niques  should  be  incorporated  as  evaluation  tools  that  can  be  called  to  use  by  the 
DSN  system  developer  for  analysing  or  verifying  the  construction  of  his  system. 
However,  the  complexity  of  a  DSN  system  precludes  the  use  of  such  analytic 
techniques  in  many  cases.  Therefore,  another  approach  is  called  for.  There  are  a 
number  of  statistical  and  other  techniques  that  can  be  applied  to  the  evaluation 
of  a  system’s  performance  by  analyzing  that  system's  performance  data  and  com¬ 
paring  it  to  some  standard.  For  example,  suppose  the  expert  system  being 
developed  is  Intended  to  construct  hypotheses  that  explain  the  sensor  data.  A  set 
of  evaluation  tools  that  might  be  provided  could  be  some  to  compare  the  asser¬ 
tions  being  hypothesized  by  the  expert  system  with  the  "ground  truth" 
represented  in  the  scenario  description  that  is  driving  the  simulation  of  that 
expert  system’s  task  performance.  We  believe  that  this  simulation  based 
approach  to  a  design  methodology  can  fruitfully  employ  a  great  number  of  such 
statistical  tools  since  these  tools  yield  useful  descriptions  of  such  things  as  the 
effectiveness  or  accuracy  of  system  behavior. 

The  next  levci  up  in  the  figure  represents  the  presence  of  libraries  that  can 
provide  templates  of  types  of  structures  that  are  likely  to  be  useful  In  a  wide 
variety  of  design  situations.  This  can  include  templates  that  describe  commonly 
used  forms  of  DSN  system  components,  templates  for  specific  types  of  communi¬ 
cations  relations  among  nodes,  or  command  structure  templates.  Additionally,  It 
would  be  extremely  useful  to  have  a  library  of  standard  tost  cases  that  could  be 
used  by  system  designers  developing  DSN  systems  for  well  known  classes  of  appli¬ 
cation.  The  testbed  could  provide  assistance  In  the  form  of  template  "instantia- 
t.ors"  that  can  be  called  into  use  by  the  designer  to  Insert  a  specialized  form  of 
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some  template  Into  his  design. 

Finally,  the  next  level  of  the  system  provides  for  a  set  of  tools  to  explicitly 
aid  the  designer  of  a  DSN  system  in  both  the  construction  and  test  of  his  design. 
\Vc  have  done  some  experimenting  with  this  notion  in  our  work  on  Schemer  by 
looking  at  ways  to  simplify  and  automate  the  more  repetitive  aspects  of  the  sys¬ 
tem  designer's  task.  For  example,  we  have  developed  a  format  for  constructing 
new  KSs  in  the  system  which  structures  the  organization  of  the  KS  definition  for 
the  designer  by  providing  a  template  for  KS  definition.  When  filled  out  this  tem¬ 
plate  Is  automatically  used  by  a  design  tool  to  construct  the  actual  KS  and  its 
underlying  code  object.  Other  tool  we  are  experimenting  with  include  check¬ 
pointing  facilities  and  tracing  facilities  for  examining  the  conditions  that  lead  to  a 
particular  action  by  the  expert  system.  An  Important  aspect  of  this  topic  of 
design  support  is  that  of  explanation  [18].  Tools  to  provide  natural  language 
descriptions  of  the  performance  of  a  complex  system  like  a  DSN  system  are  sorely 
needed.  As  a  starting  point  existing  Al  techniques  for  producing  explanations  of 
system  performance  would  be  an  important  addition  to  the  design  testbed. 

There  Is  one  more  limitation  of  the  earlier  version  of  Schemer  that  we  have 
yet  to  address.  This  is  the  need  for  modeling  elements  In  a  DSN  system  that 
have  the  complexity  and  sophistication  of  intelligent  agents.  In  Section  4.2  we 
described  the  general  model  that  Is  to  be  used  to  accomplish  this  modeling.  This 
general  model,  shown  In  Figure  4-6,  Is  Itself  a  complete  AI  knowledge  based 
expert  system  architecture.  The  problem  then  Is  to  expand  Schemer  so  that  such 
a  model  can  be  embedded  In  a  larger  expert  system  framework.  We  have  pro¬ 
vided  for  this  by  expanding  the  definition  of  a  knowledge  source  to  that  It  can  be 
instantiated  as  a  complete  blackboard  subsystem  with  its  own  blackboard  and  its 
own  internal  KSs.  Figure  4-9  exemplifies  this  type  of  KS.  The  example  of  Figure 
4-9  indicates  that  the  code  of  the  KS  can  be  a  blackboard  CONTROLLER  and 
the  data  space  slot  of  that  KS  can  be  an  entire  Internal  blackboard.  We  will 
refer  to  this  type  of  KS  as  a  "subsystem  KS"  (SSKS).  This  simple  move  provides 
an  enormous  increase  in  the  modeling  capabilities  of  the  Schemer  system.  The 
overall  black baord  framework  of  the  Schemer  architecture  Itself  can  now  contain 
embedded  models  of  blackboard  systems.  These  embedded  export  system  archi¬ 
tectures  can  more  fully  model  the  complex  Intelligent  agents  in  a  DSN  system. 
There  are.  however,  two  points  that  should  bo  clarified  in  order  to  understand 
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how  such  a  complex  KS  can  be  used  In  the  encompassing  blackboard  framework. 


First,  the  so-called  "local”  blackboard  of  an  embedded  SSKS  can  in  fact  be 
a  shared  area  of  an  encompassing  blackboard.  That  is,  the  content  of  the  SSh'S's 
blackboard  can  be  a  pointer  to  data  actually  external  to  that  SSKS.  This  tech¬ 
nique  is  needed  to  provide  for  the  sharing  of  information  that  might  be  called  for 
in  some  models.  It  could  also  presumably  be  a  way  of  modeling  how  specific 
events  that  are  external  to  an  SSKS  could  trigger  specific  actions  within  that 
complex  system. 

The  second  point  to  be  clarified  has  to  do  with  the  way  that  such  an 
embedded  architecture  is  controlled  by  the  top  level  of  Schemer.  As  with  any 
other  type  of  KS  a  SSKS  Is  Initially  called  into  action  by  occurence  of  the  event 
described  in  Its  TRIGGER  slot.  When  actually  executed  the  CONTROLLER  (in 
the  code  slot  of  the  SSKS)  Is  used  In  place  of  the  top  level  CONTROLLER.  If 
the  SSKS  halts  (l.e.,  its  AGENDA  becomes  empty)  then  that  KS  execution  can 
terminate  Just  as  simpler  KSs  do  and  the  top  level  CONTROLLER  resumes  its 
operation.  Under  certain  conditions,  however,  it  may  be  necessary  to  be  able  to 
Interrupt  the  operation  of  the  SSKS  In  order  to  perform  some  special  operation. 
An  example  of  this  would  be  the  use  of  some  evaluation  KS  that  Interrogates  the 
knowledge  base  of  the  SSKS  periodically  to  obtain,  say,  performance  statistics  on 
that  SSKS.  In  order  to  provide  for  this  type  of  control,  the  top  level  CON¬ 
TROLLER  can  insert  some  annotations  in  the  controller  of  the  SSKS  that  causes 
that  embedded  Interpreter  to  suspend  periodically.  When  the  SSKS  suspends  the 
top  level  can  check  for  the  occurence  of  assertions  on  the  blackboard  of  the  whole 
system  that  could  trigger  high  priority  KS  to  perform  some  action  and,  if 
appropriate,  even  cause  the  suspended  SSKS  to  be  aborted  rather  than  resumed. 
This  latter  type  of  control  would  be  needed  If.  for  example,  the  designer  had 
inserted  a  control  KS  that  waited  for  the  object  being  modeled  by  the  SSKS  to 
achieve  some  special  state  and  then  halt  the  execution  of  the  simulation  of  which 
the  SSKS  was  a  part. 


1 


4.4  SUMMARY  AND  DISCUSSION 


Let  us  summarize  the  discussion  of  the  testbed  arhltecture  just  presented. 
We  have  capitalized  upon  the  analogy  of  expert  systems  to  decision  makers  by 
proposing  a  design  methodology  that  treats  the  design  of  a  DSN  system  as  Identi¬ 
cal  to  the  problem  of  designing  a  system  of  distributed,  cooperative  expert  sys¬ 
tems.  The  architecture  we  have  developed  and  Implemented  In  a  preliminary 
form  provides  a  very  powerful  and  general  computational  model  within  which  to 
devise  the  broadest  class  of  DSN  system  structures. 

This  approach  to  a  design  methodology  Is  quite  radical  In  Its  emphasis  upon 
techniques  of  empirical  observation  of  system  behavior  as  a  means  of  evaluating 
system  design.  Becuase  of  this  emphasis  on  performance  observation  and 
analysis,  a  major  requirement  of  the  testbed  Is  that  It  supports  the  construction 
of  test  scenarios  that  can  be  used  to  elicit  such  performance  from  the  system. 
Thus,  the  ability  of  this  testbed  architecture  to  support  rapid  construction  of 
such  scenarios  Is  almost  as  significant  as  the  rapid  development  or  the  DSN 
design  Itself. 

However,  as  central  as  we  hold  the  empirical,  rapid  prototyping  approach, 
we  do  not  adhere  to  this  approach  to  the  exclusion  of  the  use  of  other  more  ana¬ 
lytic  techniques  of  design  evaluation.  It  is  a  strength  of  this  approach  that  such 
techniques  can  be  readily  Incorporated  In  the  testbed  as  specific  tools  for  evalua¬ 
tion  that  can  be  used  in  conjunction  with  the  simulation  and  observational  facili¬ 
ties  of  the  testbed. 

For  the  present  project  we  are  focusing  on  the  development  of  the  applica¬ 
tion  of  our  test  bed  concept  to  the  design  of  DSN  systems  that  are  built  upon  the 
use  of  the  GTC  and  the  Information  fusion  algorithm  as  the  fundamental  node 
capability.  As  noted  above,  we  have  been  fortunate  In  having  been  able  to  gain  a 
great  deal  of  experience  with  this  concept  by  actually  Implementing  partial  ver¬ 
sion  of  such  a  testbed  for  use  in  the  development  of  various  expert  system  appli¬ 
cations.  However,  the  type  of  testbed  architecture  plus  the  full  range  of  capabili¬ 
ties  we  have  presented  here  has  yet  to  be  implemented.  We  see  this  additional 
effort  as  an  important  next,  step  In  assessing  the  validity  of  our  concepts  for  DSN 
system  development  and  for  their  value  In  assessing  other  technologies  such  as 
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the  Generalized  Tracker/Classlfler  (GTC)  or  other  more  analytic  algorithms. 
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5.  SIMULATION  EXAMPLES 


5.1  INTRODUCTION 

A  simulation  of  a  distributed  sensor  network  was  performed  to  test  and 
evaluate  algorithms  and  to  explore  various  technical  Issues  experimentally.  The 
current  simulation  focuses  on  the  processing  within  each  node  and  a  perfect  com¬ 
munication  model  is  assumed.  Each  node  In  the  network  Is  equipped  with  a  GTC 
(Generalized  Tracker/Classlfler)  which  processes  the  local  sensor  data  and  an 
Information  fusion  module  which  fuses  the  information  sent  from  the  other  nodes 
with  the  local  Information.  The  present  status  of  the  simulation  effort  Is  as  fol¬ 
lows: 


-  The  communication  pattern  Is  arbitrary.  Any  communication  between 
any  two  nodes  can  be  set  up. 

-  The  maximum  number  of  nodes  In  the  network  Is  four.  There  Is  no  con¬ 
ceptual  difficulty  In  Increasing  the  limit  on  the  number  of  nodes  but  simu¬ 
lation  time  will  Increase  substantially  since  a  single  computer  Is  used  to 
simulate  a  distributed  system. 

-  The  processing  of  the  local  sensor  data  Is  by  means  of  the  GTC  developed 
In  the  previous  project  (!].  Information  fusion  Is  based  on  algorithms  for 
hypothesis  formation  and  evaluation  described  In  Section  2. 

-  The  language  for  the  simulation  Is  Lisp.  Lisp  has  been  chosen  because  of 
the  data  structure  and  the  plan  of  converting  the  simulation  to  run  under 
the  architecture  of  Section  4. 
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In  order  to  handle  arbitrary  communication  patterns  among  the  nodes,  the 
Information  fusion  algorithm  Includes  mechanisms  to  trace  the  histories  of  the 
tracks  and  hypotheses  In  the  Information  graph.  Without  any  loss  of  generality. 
Information  fusion  from  multiple  nodes  Is  carried  out  sequentially  In  a  binary 
form,  l.e,  to  fuse  the  information  from  node  A,  B  and  C,  we  first  fuse  that  of  A 
and  B,  and  then  the  result  Is  fused  with  the  Information  from  C.  This  simplifies 
the  Implementation  of  the  fusion  algorithm  considerably. 

In  this  section,  some  simulation  results  for  two-node  and  four-node  sensor 
networks  are  presented  to  Illustrate  the  performance  of  the  DSN  fusion  algo¬ 
rithm.  For  both  examples,  a  simple  discrete-state  road  network  scenario  was 
chosen  and  the  target  dynamics  were  assumed  to  be  Markov  with  the  road- 
segments  as  states.  The  main  reason  for  using  the  simple  target  dynamics  and 
scenario  was  to  minimize  any  unnecessary  numerical  complexity  due  to  target 
motion  and  to  concentrate  more  on  Issues  resulting  from  arbitrary  communica¬ 
tion  pattern.  The  simulation  program,  however,  Is  capable  of  handling  more 
complicated  scenarios  If  the  appropriate  algorithms  are  Included. 

The  underlying  models  In  the  scenario  are: 

a.  Targets  are  moving  along  the  road  network  with  discretized  straight-line 
segments. 

b.  The  target  dynamics  are  Markov  with  a  given  transition  matrix. 

c.  Each  sensor  measures  position  (segment  number)  along  the  road  with 
some  uncertainty  due  to  the  bearing  and  range  measurement  noise. 
Each  sensor  also  has  certain  masked  regions  which  It  cannot  observe. 

d.  The  probability  of  detection  of  a  target  In  each  road-segment  by  a  sen¬ 
sor  Is  a  function  of  sensor  masking  and  the  relative  sensor  location. 

In  addition  to  this,  independent  and  Identically  distributed  target  models  have 
also  been  assumed  In  the  current  simulation. 
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5.2  TWO-NODE  COMMUNICATION  NETWORK 

First  we  consider  the  two-node  case,  assuming  each  node  has  only  one  sen¬ 
sor.  The  sensors  observe  the  same  road  network  although  they  have  different 
flelds-of-view.  The  road  network  and  the  location  of  the  sensors  are  shown  In 
Figure  5-1. 


5.2.1  Scenario 

Each  Individual  target  position  Is  represented  by  the  segment  number  and 
Its  evolution  Is  assumed  to  be  a  Markov  process.  The  target  state  at  any  time  Is 
thus  characterized  by  a  probability  distribution  on  the  road  segment.  Because  of 
the  terrain,  the  two  sensors  have  different  masked  regions  (see  Figures  5-2  and  5- 
3).  Each  sensor  generates  a  measurement  In  the  following  way.  The  detection  or 
a  target  at  state  x,  by  a  sensor  depends  on  the  detection  probability  which  Is  0 
whenever  the  target  Is  In  a  masked  region  relative  to  the  sensor.  For  any 
detected  target  located  at  x ,  the  measurement  y ,  which  Is  also  a  segment 
number.  Is  generated  according  to  the  following  conditional  probability  distribu¬ 
tion  function:  (see  Figure  5-4) 

P(V  I  * )  £<*i  (Vi  W(V> )  (5.1) 

I 


where 

r  m*x(  Vt  ) 

<*,(»<)=  J  J  9r(r  I  r(z))g£6 \0(x))drdO  (5.2) 


U{yi)  Is  a  uniform  function  on  segment  y,  with  unity  value  and  gr(r  |  r(x))  and 
g^O  |3(x))  are  sensor  characteristics  corresponding  to  the  the  measurement  uncer¬ 
tainty  In  range  and  bearing  given  the  average  range  and  bearing  of  a  particular 
target  location  x .  False  alarms  are  also  added  according  to  the  sensor  model. 


The  total  number  of  targets  Is  constant  but  unknown  and  Its  a  priori  distri¬ 
bution  Is  Poisson  with  mean  v0.  The  number  of  false  alarms  In  each  scan  Is  also 
Poisson  with  mean  vyA  for  each  sensor.  The  target  positions  are  Independent 
and  Identically  distributed  with  the  a  priori  distribution  uniform  over  the  road 


5-3 


///////V/Z/Z 

mrmrnn 


Masked  Region 


Figure  5-2:  Masked  Regions  of  Sensor  1 
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Figure  5-3:  Masked  Regions  of  Sensor  2 
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Figure  5-4:  Conditional  Probability  Distribution  p(y jz) 


network  states,  and  targets  are  expected  to  move  Into  the  fleld-of-vlew  from  the 
edges  at  any  time. 


5.2.2  Communication  Schemes 

Three  types  of  communication  schemes  were  examined: 

a.  Broadcast  communication:  the  two  nodes  share  and  fuse  their  Informa¬ 
tion  every  third  scan. 

to.  One-way  communication:  node  1  sends  information  to  node  2  every 
third  scan  but  node  1  gets  nothing  from  node  2 

c.  Decentralized:  the  nodes  do  not  share  any  Information 
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If  sensor  data  are  broadcasted  every  third  scan,  then  the  broadcast  case  can 
be  regarded  as  a  centralized  scheme  where  the  central  node  receives  all  the  meas¬ 
urements  periodically.  In  the  case  when  only  tracks  and  hypotheses  are  commun¬ 
icated,  the  processing  Is  essentially  hierarchical  with  Intermediate  results  avail¬ 
able  at  each  node  between  periodic  Instants.  The  decentralized  case  Is  the  other 
extreme  situation.  In  each  case,  all  the  hypotheses  at  each  node  are  communi¬ 
cated.  The  parameters  used  In  the  simulations  are  given  In  table  5-1. 

In  each  simulation,  all  the  hypotheses  were  examined  and  compared  to  the 
true  trajectories  of  targets  according  to  the  measurement-to-target  association 
histories.  The  hypothesis  best  matched  to  the  ground  truth  is  defined  as  a  true 
hypothesis.  The  most  likely  hypothesis  (highest  probability)  Is  called  the  best 
hypothesis. 


Expected  number  of  targets 


Expected  number  of  false  alarm 


VFA 


1/scan 


Probability  of  detection 


Pn  max 


0.9 


Measurement  error 


range 
bearing 
radial  velocity 


Or 

09 

cr„ 


0.5  (km) 

0.2  (radius) 
0.1  (km/mln) 


Pruning  threshold 


0.05 


Table  5-1  Simulation  Parameters 
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5.2.3  Simulation  Results 


In  the  following  we  present  the  results  of  some  sample  runs.  More  extensive 
simulation  results  will  be  performed  when  the  development  of  the  test  bed  is 
completed. 

The  target  scenario  (ground  truth)  and  the  probabilities  of  detection  arc 
given  In  Figures  5-5  .5-6  and  5-7.  As  shown  in  Figure  5-5,  two  targets  A  and  B 
move  from  left  to  right  on  the  road  network,  where  the  subscript  on  each  target 
represents  the  corresponding  time  index.  Note  that  In  Figures  5-6  and  5-7,  the 
detection  probabilities  are  lower  on  the  roads  which  are  almost  orthogonal  to  the 
sensors'  lines  of  sight.  This  can  be  used  to  approximate  the  effect  of  the  velocity 
Doppler  on  a  MTI  radar. 

Figures  5-8  to  5-13  show  the  probabilities  of  the  best  hypothesis  versus  the 
true  hypothesis  at  each  scan  for  two  nodes  under  different  communication 
schemes.  The  results  of  the  decentralized  case  are  shown  in  Figure  5-12  and  Fig¬ 
ure  5-13  for  node  1  and  node  2.  As  can  be  seen  from  the  figures,  the  performance 
of  each  node  Is  quite  poor.  The  probability  of  the  true  hypothesis  only 
approaches  that  of  the  best  hypothesis  during  the  last  four  scans  of  node  1.  For 
node  2,  the  probability  of  true  hypothesis  is  never  higher  than  0.2  as  can  be  seen 
In  Figure  5-13.  This  Is  so  because  In  the  decentralized  case,  each  node  only 
processej  Its  own  local  observations  which  are  quite  sparse  with  the  given  masked 
regions. 

Figures  5-10  and  Figures  5-11  present  the  results  with  one-way  communica¬ 
tion.  Obviously,  node  2  has  better  performance  than  node  1  reflecting  the  fact 
that  node  2  receives  more  Information  than  node  1  due  to  the  communication 
pattern.  Note  here  that  the  behavior  at  node  1  is  exactly  the  same  as  in  the 
decentralized  case  (see  Figure  5-10  and  5-12).  This  Is  obvious  because  as  In  the 
decentralized  case,  node  1  does  not  receive  any  Information  from  node  2.  Simi¬ 
larly,  during  the  first  two  scans,  the  results  of  node  2  are  the  same  as  In  the 
decentralized  case  since  no  Information  has  been  received  yet  (see  Figure  5-11  and 
5-13).  From  scan  3  on,  because  the  Information  from  node  1  begins  to  arrive  via 
communication,  the  probability  of  the  true  hypothesis  Increases  and  reaches  0.8 
In  a  few  scans. 
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The  results  of  the  distributed  case  given  In  Figure  5-8  and  5-9  for  node  1 
and  node  2  clearly  show  Its  superior  performance.  Almost  all  the  best  hypotheses 
are  the  true  hypotheses  as  can  be  seen  In  Figure  5-8  and  5-9.  Comparing  Figure 
5-8  and  5-9  we  can  see  that  node  1  and  node  2  have  the  same  performance  at  the 
communication  times,  this  Is  true  because  both  nodes  share  the  exactly  same 
Information  when  broadcast  communication  takes  place. 


5.3  FOUR-NODE  COMMUNICATION  NETWORK 

There  are  now  four  nodes  each  with  only  one  sensor  observing  the  same 
road  network. 


5.3.1  Scenario 

The  sensor  locations  and  their  fields-of-vlew  with  respect  to  the  road- 
network  are  shown  In  Figure  5-14.  The  target  scenario  Is  the  same  as  In  the 
two-node  case.  Because  of  the  terrain,  the  masked  regions  for  the  sensors  are 
different.  The  probability  of  detection  for  each  sensor  Is  shown  In  Figure  5-15  to 
Figure  5-18. 


5.3.2  Communication  Schemes 

A  hierarchical  type  of  communication  scheme  was  tested: 

1.  Every  odd  scan  node  1  sends  Information  to  node  2,  and  node  3  sends 
Information  to  node  4. 

2.  Every  even  scan  node  4  sends  Information  to  node  2. 

l.e,  node  1  and  node  3  only  transmit  Information  to  other  nodes,  node  4  Is  an 
Intermediate  recelver/processor/transmltter  and  all  Information  Is  thus  collected 
by  node  2  with  communication  delays.  The  communication  pattern  and  the 
Information  graph  are  shown  In  Figure  5-19  and  Figure  5-20. 
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Figure  5-7:  Probability  of  Detection  of  Sensor  2 
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Probability 


Communication  Time 

Figure  5-8:  Best  Hypothesis  versus  True  Hypothesis  for  Node  1 
In  Two-Node  Broadcast  Case 


Probability 


Figure  5-9:  Best  Hypothesis  versus  True  Hypothesis  for  Node  2 
In  Two-Node  Broadcast  Case 
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Figure  5-10:  Best  Hypothesis  versus  True  Hypothesis  for  Node  1 
In  Two-Node  One-Way  Communication  Case 
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Figure  5-11:  Best  Hypothesis  versus  True  Hypothesis  for  Node  2 
In  Two-Node  One-Way  Communication  Case 
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Figure  5-12:  Best  Hypothesis  versus  True  Hypothesis  for  Node  1 
In  Decentralized  Case 
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Figure  5-13:  Best  Hypothesis  versus  True  Hypothesis  for  Node  2 
In  Decentralized  Case 
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Figure  5-14:  A  Four-Node  Scenario 
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Figure  5-15:  Probability  of  Detection  of  Sensor  1 
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Figure  5-17:  Probability  of  Detection  of  Sensor  3 


Figure  5-18:  Probability  of  Detection  of  Sensor  4 
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5.3.3  Simulation  Results 


The  same  simulation  parameters  as  In  the  previous  example  were  used. 
Figure  5-21  to  Figure  5-24  show  the  probabilities  of  the  best  hypotheses  versus 
true  hypotheses  at  every  scan  for  each  node.  From  the  results  we  can  see  that 
node  2  and  node  4  have  better  performance  than  node  1  and  node  3.  This  Is  so 
since  they  have  more  Information. 

The  true  hypotheses  of  node  1  and  node  3  are  never  higher  than  0.3  (see 
Figure  5-21  and  Figure  5-23),  similar  to  the  previous  examples,  this  Is  because 
they  only  process  their  own  local  data  which  Is  not  very  good  and  never  receive 
Information  from  the  other  nodes  to  confirm  or  correct  their  hypotheses.  Node  4 
does  not  receive  any  Information  from  node  1  or  node  2,  however,  node  4  does 
receive  Information  from  node  3,  which  gives  It  fairly  good  sensor  coverage  and 
detections  (see  Figure  5-14,  5-17  and  5-18),  resulting  in  reasonably  good  perfor¬ 
mance  (see  Figure  5-24). 

From  the  results  of  node  2  (Figure  5-22),  wee  can  see  that  the  probability  of 
true  hypothesis  approaches  that  of  the  best  hypothesis  after  2  scans.  It  Is  not 
clear  from  this  sample  run  how  much  better  the  performance  of  node  2  compares 
to  that  of  node  4.  However,  It  Is  obvious  that  node  2  and  node  4  perform  better 
than  node  1  and  node  3  because  of  the  communication  structure. 


5.4  CONCLUSION 

The  Information  fusion  algorithms  developed  in  Section  3  have  been  tested 
via  simulations  using  discrete-state  road  network  examples.  Various  communica¬ 
tion  schemes  with  different  number  of  nodes  have  been  examined.  The  simula¬ 
tion  results  have  shown  that  the  algorithms  produce  the  expected  performance. 

More  extensive  simulations  using  other  scenarios  will  be  conducted  after  the 
development  of  the  simulation  environment  Is  completed.  The  simulation 
environment  Itself  Is  being  enhanced  to  improve  its  flexibility  and  efficiency. 
When  this  development  of  the  simulation  environment  Is  complete,  we  should  be 
able  to  perform  more  extensive  simulations  using  other  scenarios.  In  particular. 
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Figure  5-21:  Best  Hypothesis  versus  True  Hypothesis  for  Node  1 
In  Four-Node  Case 


Probability 


He„sl  Hypothesis 


O - •OTrue  Hypothesis 


Scan 


Figure  5-22:  Best  Hypothesis  versus  True  Hypothesis  for  Node  2 
in  Four-Node  Case 
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Figure  5-23:  Best  Hypothesis  versus  True  Hypothesis  for  Node  3 
In  Four-Node  Case 
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Figure  5-24:  Best  Hypothesis  versus  True  Hypothesis  for  Node  4 
In  Four-Node  Case 
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we  Intend  to  use  other  target  and  sensor  models  and  study  the  effect  of  varying 
parameters  such  as  hypothesis  pruning  threshold,  detection  probability,  false 
alarm  rate  and  measurement  errors. 

Various  ways  of  speeding  up  the  processing  of  each  node  as  better 
hypothesis  management,  as  well  as  ways  of  improving  the  overall  system  perfor¬ 
mance,  such  as  better  communication  strategies,  sensor  control,  etc.  would  also 
be  investigated  using  this  simulation  environment. 
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Appendix:  Distributed  Estimation  and 
Multitarget  Tracking 


This  appendix  summarizes  all  the  formal  arguments  concerning  distributed 
estimation  and  distributed  multitarget  tracking  in  the  distributed  sensor  network 
context . 


1.  Formal  Definition  of  Distributed  Sensor  Network 

We  first  formalize  the  concept  of  the  distributed  sensor  network  in  terms  of 
an  information  graph.  Let  A'  be  a  nonempty  finite  set  of  information  processing 
nodes  (simply  nodes  or  estimation  agents)  and  S  be  a  nonempty  finite  set  of  sen¬ 
sors  (or  information  sources).  A  nonempty  set  Y, ,  called  sensor  format  space  (or 
information  format  space),  is  given  for  each  s  in  S .  For  each  n  in  A’,  a  set  5„  of 
private  sensors  is  given.  Each  S„  is  a  subset  of  5.  Then,  for  a  given  interval 
T =[<0.f  ,j,  a  subset  Z  of  the  set 

UY  ,XTx{s} 

« es 


is  called  the  total  information  (obtained  in  T).  Each  element  (z  .( ,*  )  in  total 
information  Z  is  called  a  data  3et  (or  sensor  report)  generated  by  sensor  s  at  time 
t  Any  subset  Z  of  Z  is  railed  partial  information  set  or  simply  information  set. 
Given  the  total  Information  Z,  the  set 

K.--{{t  ,s  )£T  XS  |  (r  ,t  ,s  )£Z  for  some  z  } 


is  called  total  index  set  for  Z.  Any  subset  of  A  of  K  Is  called  partial  index  set  or 
simply  index  set. 

A  subset  C  of  T  X  T  X  <V  X  A  Is  called  communication  schedule.  An  element 
\t.t'.n.n')  In  C  represents  the  transmission  or  a  message  by  node  n  at  time  t 
which  is  received  by  node  n '  at  time  / '.  We  call  any  element  of 


A- 1 


I  -  I  ST  U  I  sit  U  I CT  U  I  fit 


an  information  node,  where 

1st  -  K  X  {ST} 

I sr  =  K  X  {SR} 

Ict  —  {(t  ,n  ,CT )  \  (t  .t' ,n  ,n')(zC},  and 
leu  —  {«.». CR)\(t'.t,n'.n)eC}. 

We  call  an  Information  node  In  IsT  (Iw ,  lCT  or  lnt .  respectively)  a  sensor 
transmitting  node  ( sensor  receiving  node,  communication  transmitting  node,  com¬ 
munication  receiving  node,  reps.).  An  information  structure  Is  a  binary  relation 
<  on  I,  which  Is  reflexive  and  antisymmetric,  i  <i'  means  t  <i'  but  1  j^i 
i  (—1'  means  1  Is  an  Immediate  predecessor  of  t  '.  The  ordered  set  (I.<)  Is  called 
an  information  graph. 

Let  us  define 


K,n,=  {(f  ,3  )€K  I  9  }, 

I.iV  =  K,n,x{5r}.  I$>  =  K<"'x{Sfl}. 
IrV=  {(f.n.CDelrr  |  teT}, 

Ifl/  {( t  ,n  ,L,R  )(zlcn  |  t  £  1  },  and 

v"  ii»’ui;-yu  i;-v- 


Then  the  following  assumptions  are  made  on  the  network: 
flasir  Assumptions 

■  AT  (No  Sensor  Sharing.  D  0  for  all  ( n  .n ')(  \  \  .V  such  that  n/n'. 

jA2j  (Flnltencss)  Z  and  C  are  both  finite. 

jA.'lj  (No  Indexing  Confusion)  Z  is  Isomorphic  to  K. 

[Alj  (Information  Sources)  I’.ach  \k.ST)  in  l>T  is  minimum  In  1  and  has  only  one 


A-V2 


r 


successor  so  that  ( k  .ST }  \—  tk  ,SR  ;(  Gls-W  ) 

[A5]  (Information  Exchanges)  (t  ,n  ,CT  )  f—  ( / ' .n'.CR  )  If  and  only  if 

(<  .I'.n  .n')€C. 

(A6j  (Causality  1)  (m  .t  .1  )<im  '.t'.l')  implies  t<t 

[A7j  (Causality  2)  The  binary  relation  <  Is  transitive. 

jA8]  (Total  Order)  For  each  n  in  X ,  (Iln,,<)  is  totally  ordered. 

Remarks: 

(1)  [At]  to  [A5]  are  more  or  less  standard  assumptions. 

(2)  [A4]  implies  no  delay  in  sensor  reporting. 

(3)  [A5]  allows  us  to  model  communication  delays. 

(4)  [A6j  prohibits  any  negative  time  delay. 

(5)  [A7]  prohibits  any  cycle  in  (I,<). 

(6)  [A8]  implies  sequential  data  processing  (and  implicitly  perfect  memory)  for 
each  node. 

Given  an  information  graph  (I.<),  we  can  assign  a  maximum  amount  of 
information  to  each  information  node  i€l.  More  precisely,  for  each  i 6l, 

K{"  {keK  \(k.ST)<i}  (1) 

is  called  the  maximum  index  set  at  node  i .  Similarly 

Z"’’  =  {(*  .*  )GZ  |  Jfce/v"1}  (2) 

is  called  the  maximum  information  set  at  i.  Then  the  following  observations  fol¬ 
low  immediately  from  the  definitions: 

Proposition  1: 

(1)  K“  ‘  -  {keK  j  [k  .SR  )<i )  for  alt  i  in  I. 

(2)  AM"C  A'"'1  if  «■<*•'. 

(3)  A'"  1  U  A'!l  '  for  all  i  in  I. 

I  '  '  I 

(4)  A  "  U  A  ‘  1  for  all  i  in  I. 

i a  -i 


The  proof  is  obvious. 


Remark:  The  converse  of  the  (2)  of  Proposition  /  Is  not  necessarily  true  as  can 
been  seen  from  the  following  counterexample: 


A'"  '  —  K"'  but  neither  *._><«,  or  i,<t2. 

Due  to  the  Isomorphism  between  Z  and  K,  all  the  K' s  In  Proposition  1  can 
be  replaced  by  Z ’s,  l.e.,  we  have 

Proposition  2: 

(l")  /"  {(z  ,k  )£Z  \  (k  .SR  )<i  }  for  all  i  in  I. 

(2)  Z["CZ'1''  if  i<i\ 

(3)  Z,if=  U  ZH)  for  all  i  ini. 

i '  <  i 

(4)  Z"]  =  U  Z{i']  for  all  i  in  I. 

•  'I-** 


In  the  following,  we  describe  two  lemmas  which  are  direct  consequences  of 
the  deflntions  and  are  used  In  the  following  sections. 

Lemma  l  For  any  set  /  of  Information  nodes,  we  have 
M  K" '  ~=  U  «'<«  r<>r  all  i£  I> 

id 

Proof:  Suppose  k  cPi A'  ’ '.  Then  by  definition  t'  =  \k  ,SR  )<i  for  all  :£/.  or 
i  c< 

kcK  1  and  i'<«  for  all  »£/.  The  converse  Is  obvious.  Q.F.D. 

According  to  this  lemma,  given  a  set  /  of  Information  nodes,  the  Intersec¬ 
tion  of  the  maximum  Index  sets,  or  equivalently  common  information  contained 
in  i  •olleellon  of  the  maximum  Information  obtained  in  a  set  of  Information 
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nodes,  is  characterized  as  the  union  of  maximum  index  sets  on  l  tie  set  of  common 
predecessor  information  nodes.  A  stronger  version  of  Lemma  1  is  the  following: 

Lemma  S:  Suppose  /,,  be  a  set  of  information  nodes  such  that 
(1  )  l>  t /„>  -l.  ' 

(*2)  n  K'"  jt  and 

'  •- 1„ 

(3)  there  is  no  pair  (i  .i’)£l „X  1 such  that  i  <«'. 

Then. 

/,  -  {«  ,GlfT  i  * , < «»  f°r  all  i„Gl„} 


is  not  empty  and  we  have 


n  K'"  U  A'"’  (5) 

<e/„  <e/, 


Proof:  7,-^0  implies  U  A'"’  0.  Therefore  it  sufTices  to  prove  (5).  As  in  Lemma 

1,  it  follows  directly  from  the  definitions  that  U  A1"  is  a  subset  of  Pi  A'"  1 

I  c-i,  <e/„ 

To  prove  the  other  inclusion,  suppose  tg  fl  A'1'"1  or  ( k,SR)<i„  for  all 

*  (fc  1 0 

i0e/ 0.  Let  k~(9.t)eS„  X  T  where  n£A>  is  the  node  uniquely  ( Assumption  [A  1  ] ) 
determined  by  ft.  Since  I1"’  is  totally  ordered  ( Assumption  [A8]),  assumptions  (1) 
and  (3)  guarantee  existence  or  an  i”  in  /oni<n''  for  some  n'6Ar  such  that  n'^n  . 
Hence,  there  exists  a  transmission  node  t'  which  belongs  to  n,  i.e.,  t'Glr'r.  such 
that 

{k.Slt)  <  t’  <  i"  {») 


for  some  t"  In  /„.  Let  t  be  the  smallest  element  »'  In  I/.y  which  satisfies  (0)  with 
some  i"  in  /„. 


I  for  :inv  sot  A  .  //  ( ,-i  i  is  it>  i-:iriliiiaiit.v.  or  l  In-  mttnliiT  of  it*  ol<-nu'iit> 


A  r. 


Then,  for  any  t,,£/(,\f " '  wo  must  have  t<t„  because  {k  ,SR  )  must  be  con¬ 
nected  through  a  communication  link  which  includes  i.  If  i4,e/(,Dl"".  we  must 
also  have  r<t„  because  I1"'  Is  totally  ordered  and  contradicts  with  assump¬ 
tion  (.')).  Q.E.D. 


2.  Distributed  Estimation  Problems 

This  section  discusses  the  distributed  estimation  problems  with  arbitrary 
information  graphs. 

2.1  Static  Estimation  Problems  The  object  to  be  estimated  is  modeled 
as  a  random  element  i  (called  state-of-the-world  or  simply  state)  taking  values  in 
a  measurable  space  (X.B)  w'here  X  is  a  locally  compact  Ilausdorff  space  satisfying 
the  second  axiom  of  countability1  and  B  is  the  a- field  of  Borei  sets  in  X.  Let  // 
be  a  a- finite  measure  on  (X.B)  and  call  the  measure  space  (X.B./c)  state  space. 
Implicitly  we  are  assuming  an  underlying  probability  space  (H.F .Prob  )  but  we 
rarely  must  refer  to  it. 

In  parallel,  for  each  sensor  s  eS ,  Y„  is  a  locally  compact  Hausdorff  space 
satisfying  the  second  axiom  of  countability  and  the  sensor  format  space  Is 
redefined  as  the  measure  space  (Y,  ,B,  ,fi „ )  where  B,  is  the  a-field  of  Bore!  sets  in 
Y,  and  p,  is  a  a- finite  measure  on  (Y„  ,B„ ).  All  the  sets  dellned  in  the  previous 
section  are  then  redefined  as  random  sets.  For  each  sample,  we  assume  that  all 
the  assumptions  [All  -  [A8]  are  satisfied  (at  least  with  probability  one).  Accord¬ 
ing  to  the  common  custom,  we  will  abuse  the  notations  j>  (  )  and  p  *  ■  j  ■)  to  the  full 
extent  .  We  will  list  our  assumptions  below: 

Assumptions' 

[HI ]  (Absolute  Continuity)  Random  variable  i  has  an  absolutely  continuous  dis- 


I  Till**  1>  mil\  Iht.'ium1  «  c  c;iii  iim'  ;jihJ  their  <•!<•  ftcrh  without 

rl -k . 
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tributlon. 


[B2j  (Independence!  Random  sets  K  and  C  and  random  ordered  set  (I.<)  are 
independent  of  state  x  . 

[B3]  (Conditional  Independence  and  Absolute  Continuity)  Given  x  and  K,  each 
element  in  Z  is  conditionally  Independent  from  each  other  and  has  an  abso¬ 
lutely  continuous  conditional  distribution. 


To  obtain  a  general  result  with  an  arbitrary  information  graph,  we  need  a  couple 
of  lemmas. 


Lemma  S:  Let  m  be  a  positive  integer  and  let  (a,  ),1,G(-oo.oo)m  .  For  any 
subset  M  o/M—  {l,...,m  },  define  a  (0) =0  and,  if  M^<b, 


a[M\  E  am. 

rn  £-  M 

Then,  for  any  positive  integer  n  and  for  any  n  subsets,  A/,,  -  •  •  ,A/„  ,  of  M,  we 
have 


where 


a 


n 


(UA/.l 


n 


E(-l)’-'(  E  a 

<=i  n  eN,n 


lQA/y!) 


N”  =  (iVC{l,..,n  }  |  #  ( Ar )  = «  } 


(9) 


(10) 


Proof:  We  will  use  the  mathematical  Induction.  When  n  -l,  the  statement  is 
clearly  true.  When  n  —2,  (9)  is 

a  \M ,  U  Mf,  =  a  |Af(]  -(  c  [A/,1  -  o  \M ,  D  Af  3j  (11) 


which  is  also  obviously  true  for  any  two  subsets  A/,  and  A f..  of  M.  Suppose  (he 
statement  of  the  lemma  is  true  for  n  l  when  n  - 2.  Then,  using  (II),  we  have 
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=-■  a  |  U  M, 

\  »  1  \ 

n 

j  -f  a  \Mr 

=  S  a  \M. 

j  =' 

n  1 

. ) 

i  i 

-r  S(  n‘  ' 

i  s  . 

A/eN,"  1 

n 

+  (  0"  '«! 

n 

n  m.  i 

r  =1  * 

=  Si  t)' 

1  (  E 

•  =  1 

which  proves  (9)  for  n. 

,veN," 

Q.E.D. 


For  any  Information  Index  k  in  K,  by  z*  we  mean  the  random  element  in 
Y,  such  that  (zk  .k  )=ut  . t  )£Z  is  uniquely  determined  by  k  . 


Lemma  4-  For  any  partial  information  set  Z  whose  index  set  is  K ,  we  have 
p(x  |  Z)  p(Z  |  K)  =  ( II  p(zk  \  x))  p{z)  (12) 

k  £K  ' 


The  proof  of  this  lemma  Is  a  direct  consequence  of  Assumptions  (Bl]  -  [B3] .  In 
order  to  avoid  complication,  we  will  assume  that  any  term  in  (12)  is  strictly  posi¬ 
tive  (at  least  in  an  appropriate  a.e.  notion). 

The  following  two  theorems  are  the  main  results  of  distributed  estimation 
for  fusing  the  estimates  at  various  nodes  to  obtain  a  global  estimate. 

Theorem  1:  For  every  positive  integer  n  and  for  any  n  partial  informations 
sets,  Z . . Zn  ,  we  have 

p(z\(jz,)^c  inn  pit  i  n  z.)){  "■ '  (l.D 

I  -!  t  l  A'(  N,”  }(M 

where 
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(H) 


c 


p(Uz, 

i  =-- 1 


n 


U  A'. ) 


ri  (  n  piHZj  \  n K} )>' ' 

>='  A'eN,"  ;eN  j€/v 


I’roof:  For  any  partial  Information  set  Z  with  index  set  K ,  we  define 

i i  Z  IIpi2tl*).  Then  Lemma  4  Implies 
kCh 


a\Z]  =  p(Z )  p(z  |  Z)  p(z)  1 


(15) 


Using  the  product  version  of  Lemma  3  and  applying  (15)  for  each  Z, ,  we  have 

* :  u  z,  •  =  fi(  n  ainz.iy "" 

1  =  1  1=1  JV€N,"  }€N 

-  ri(  ri  p  t  n  z,  i  nAT.)/ 

>=i  .veN,"  ;eN  jew 


n 


ru  n 

>=<  /VfN 


p(z  i  n  Zj  ))( 


h<  n  pur1)' 1 

>=-i  yvgN," 


The  last  term  becomes  p(z)  1  since  S(-I)’'1  (*?)  =  1.  Applying  (15)  to  U  Z, . 
we  have  (13)  and  (14).  Q.E.D. 

Unfortunately,  this  theorem  Is  not  sufficient  to  describe  a  general  Informa¬ 
tion  fusion  algorithm  since  (13)  may  contain  probability  densities  conditioned  by 
intersections  of  Z,  \s.  However,  these  Intersections  can  be  decomposed  further  by 
Lemma  2  in  the  previous  section.  The  result  can  be  stated  in  the  following 
theorem.  For  notational  convenience,  we  add  an  extra  element  if  to  the  set  I  of 
all  the  Information  nodes  and  let  I— IU {«(>}•  Then  (I.<)  Is  constructed  by  letting 
it  be  the  Immediate  predecessor  of  all  the  minimum  nodes  In  the  original  infor¬ 
mation  graph  (I,<i.  Then  we  have  Z A'"*' -----0. 
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Theorem  2:  For  any  communication  receiving  node  «„  in  l,-H ,  there  exists  a 
subset  /  of  set  I  of  extended  information  nodes  such  that  I  <  (This  means 
i  <«„  for  all  I  in  T .)  and 

pftjUn---  e  ll  p(z  \Zl7'f"7'  (10) 

1 6 1  I cT 


where  I  is  the  set  of  immediate  predecessors  of  t,„  ( a(i))j(j  is  some  indexed  tuple 
such  that  q(«)  is  a  nonzero  integer  for  each  i,  and  c  is  the  normalizing  constant 
defined  by 

c  =  p(Uz">| U/r,.-,) '  n  p(Z[7'\K‘7)Y'{7'  (17) 

<  €  I  i  cl  ieT 


Proof:  It  follows  directly  from  Theorem  1  that 

pi*  i  u z[i))  -  c *  n '(  n  P(x  i  nz'>'))[ "  as) 

» 6  /  m-l  ;  € ./ 

where  c'  Is  an  appropriate  normalizing  constant  and  Im  —  {./  C/  |  #  ( J)=m  }. 

When  some  J  In  (18)  is  not  a  singleton,  we  have  D  Z (J)  =  0  or  Z"'1  for  some  i' 

icJ 

in  I,  or  otherwise,  by  Lemma  2,  there  exists  a  J'CI  such  that  J'<J  and 
U  fl  Z1’  *.  Then  we  can  substitute  this  factor  using  Theorem  1.  Repeat- 

ing  this  process  as  necessary  but  finitely  many  times,  each  factor  in  the  right 
hand  side  of  (18)  can  be  reduced  to  factors  each  of  which  is  conditioned  by  Z"  1 
for  some  «'</  or  0  (the  a  priori  distribution).  When  we  cancel  the  factors  and 
gather  identical  factors,  we  have  (10)  and  (17).  Q.K.D. 


2.2  Dynamic  Estimation  Problems  In  dynamic  estimation  problems, 
the  object  to  be  estimated  ,s  a  stochastic  process.  Thus  we  redefine  x  as  a  sto¬ 
chastic  process  (x,)icr  on  state  space  (X.B.p).  Since  it  is  in  general  impossible  to 
estimate  x  Itself,  as  being  customly  in  filtering  problems,  we  are  Interested  In 

estimating  x,  for  a  fixed  time  t  In  T  or  (x(| . x,  )  for  a  given  tuple  (1,),"  ,  of 

times  In  T.  We  must  alter  the  assumptions  [111)  -  [M3]  according  to  this  new 
situation.  Although  we  may  handle  non-markovlan  processes,  it  seems  safe  to 
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maintain  markovlan  properties  to  avoid  any  unnecessary  Irregularity. 

Assumptions: 

[Cl]  (Absolute  Continuity  and  Markovian  Properties)  The  stochastic  process 
(x,)ieT  is  a  temporally  homogenious  Markov  process  with  a  state  transition 
probability, 

Fm{E  \x)  =  Prob({xt+AleE)\  *,=*)  (19) 

for  any  t£T.  for  any  At  >0  such  that  t  +AtET  and  for  any  EE B.  For 
any  given  finite  set,  the  Joint  probability  distribution  of 

<x, . x,  )  is  absolutely  continuous  with  respect  to  product  measure  . 

[C2]  (Independence)  Random  set  K  and  random  ordered  set  (I,<)  are  indepen¬ 
dent  of  ( x ,  )l€T . 

jC3]  (Conditional  Independence  and  Absolute  Continuity)  For  each  (t  .a  )  in 
TxS,  we  have  a  transition  probability  density  function  p (•  |  -)  from  the 
state  space  to  the  information  format  space  such  that,  for  any  partial  infor¬ 
mation  Z  with  index  set  K ,  we  have 

p{Z  I  (xt  )keK  )  =  p(K )  n  p(Zk  I  *tt)  (2°) 

*  k  gh 


where  (tk  ,s  )---•  k  and  (zk  .k  )  is  the  unique  element  in  Z  for  each  k  In  A'. 


If  K  is  known  beforehand  and  if  x  in  Section  2.1  is  replaced  by  (z(iU.<_k  '  . 
Theorems  2  and  S  are  still  valid  when  x  is  replaced  by  (iti ).  This,  however, 
requires  the  computation  of  a  high  dimensional  probability  distribution  and  is  not 
very  realistic.  Unfortunately,  unless  we  have  make  a  rather  strict  restrictions, 
l.e.,  bi-directional  dctcrmlnlslty,  it  may  be  impossible  to  have  a  formula  which  is 
both  general  and  applicable. 


I  Arlimlly 


wlirn  fii-liiK  lTir«>rin;ii Ion  Z  L JZ,  ,  (r(>  )kt  h  I-  i'imni;li  wln-ri'  K  I-  l  hr  lmh-v  -<'i  for  /  . 
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Deterministic  Processes:  We  considered  a  special  class  of  deterministic 
processes  with  the  following  assumption: 

Assumption  |I)1  Stochastic  process  (x,),cT  is  bi-directionally  deterministic,  l.e., 
there  exists  a  one-parameter  group  of  homeornorphlc  operators  on  X,  (<t>, 
such  that 

Prob({xt£E  }  |  xt,=z)  —  x(<t>,  _r(x  );E )  (21) 


for  all  ( t  ,t  ')€  T  X  T  (x(-;A  )  is  the  indicator  function  of  set  A  .). 

With  this  assumption,  the  stochastic  process  is  deterministic  in  both  direc¬ 
tions  of  time.  Therefore,  when  a  set  of  data  is  accumulated  in  the  past,  we  can 
consider  the  present  time  as  the  Initial  time.  We  also  assume  that  extrapolation 
of  state  probability  density  can  be  done  in  both  directions  freely.  Then,  we  can 
restate  Theorems  1  and  2  in  Section  2.1  as  follows: 

Theorem  S:  Let  i~(t,n,CR)  be  a  communication  receiving  node  in  lcf{ 
and  {i, . iM)  be  the  set  of  all  the  immediate  predecessors  of  i .  Then  we  have 


p (*<  i  u  zm)  =  c  n  (  n  p(xt  I  nz;))‘ ir  1  (22) 

m— 1  m=l  (7  C{  |„..A/  }.&  [J  )=m  ) 


where  Z„.  ~Z('"  !  and 


c  -  Pi  U  zm  |  U  Km ) 1  n  (  n  p( pz>  |  Ha;))1  '  (23) 

m— !  m=l  m  =1  \J  C  { }.#  ( J  )— m  ) 


with  Km  —  Ki>m  ’.  Moreover,  there  exists  a  subset  T  of  set  T  of  extended  informa¬ 
tion  nodes  such  that  T  <  i  and 

p(xt  \  u  Zm  )  —  d  J1  »(*,  I  Zl7,r"7'  (2-1) 

m  =  I  til 

where  (o(i))-fj  is  some  indexed  tuple  such  that  n(t’)  is  a  nonzero  integer  for  each 
1  and 
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d 


(25) 


M 

pi  U  z„, 


wi  “  I 


U#Tm)‘  FT  p  (2"7>  |  AT'r>j'*‘r> 

m  —  I  TeT 


Proof:  In  the  proof  of  Theorem  1,  redefine  a  [Z\  as 

a  \Z)  ~  El  p{zk  |  *t  ,(if )). 

keK 

Then  we  can  carry  out  the  same  proof  as  In  Theorems  2  and  S.  Q.E.D. 


3.  Distributed  Multi-Target  Tracking 


In  Appendix  C  of  [lj,  distributed  multi-target  tracking  problems  were  for¬ 
mulated  assuming  broadcasting-type  communication.  In  this  section,  we  general¬ 
ize  the  results  stated  there  to  distributed  multi-target  tracking  with  an  arbitrary 
information  graph. 

3.1  Formalism  of  Multi-target  Tracking  Problems  In  multi-target  track¬ 
ing  problems,  we  assume  stochastic  processes  whose  states  Include  number-of- 
target  component  and  sensor  data  Include  number-of-measurement  Information. 
For  this  purpose,  we  must  reformulate  the  state  space  and  the  sensor  format 
spaces.  In  general,  by  a  hybrid  space,  we  mean  a  direct  product  of  a  measurable 
set  (called  continuous  part)  in  a  Euclidean  space  and  a  finite  set  (called  discrete 
part).  Let  A'  be.  a  hybrid  space  and  p  be  the  direct  product  measure  composed  of 
Lebesgue  measure  on  the  continuous  part  and  the  counting  measure  on  the 

discrete  measure.  Then  we  consider  a^stochastic  process  on 

X-  U  A"‘x{n}  (30) 

n  =0 


where  A1'  is  a  formal  singleton.  Thus,  we  write  the  stochastic  process  as 

l(*1(l)fi'X(‘)),6r 


which  is  actually  a  stochastic  process  on  X  which  is  locally  compact  and  mctrlz- 
able  with  a  o  finite  measure  constructed  by  (p"  )„x  ,. 
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For  each  sensor  a  in  S ,  let  F„  be  a  hybrid  space  and 


y.  =  u  ( nr x{m } 

m  =0 


(31) 


where  ( V', )"  is  again  a  formal  singleton.  Let  ft,  be  the  hybrid  measure  on  Yt  for 
each  a .  Then  every  Y„  Is  locally  compact  and  metrlzable  with  a  v-finite  measure 
composed  of  (/O^i-  Thus  every  element  In  every  Y,  has  a  form  ((y,  )/L,.m  )  or 
(0,0).  The  second  element  represents  the  number  of  measurements  while  the  first 
element  Is  the  vector  of  measurement  values  in  F, .  For  each  k  In  K,  we  may 

write  an  element  in  Z  uniquely  determined  by  k  as  ((y}(k))^lk),NM(k),k).  We 
also  assume,  for  each  It  in  K,  a  random  function  Ak  whose  domain  is  included  in 

{l . Nt }  and  whose  range  is  Included  in  {l . NM(k)}.  j=Ak( »)  means  that  the 

i-th  target  is  detected  and  creates  the  /-th  measurement  at  k.  This  assumption 
excludes  split  measurements.  We  also  assume  that  there  is  no  merged  measure¬ 
ment.  This  means  every  Ak  is  l-to-1.  We  consider  the  following  random  sets 

j  =  U  {1 . NM(k))x{k}  (32) 

k  £K 


and 

A  =  {{(j\*)€J  |  j  =>M0}  |  ie{  1 . Nt}}  \  {0}  (33) 


We  call  any  subset  J  of  J  a  measurement  index  set.  Then  the  no-split/no- 
merged  measurement  assumption  implies  that,  for  any  measurement  Index  set  J . 
the  restriction  of  A  on  /  defined  by 

AjJ  =  {rH^  |  re  X}  \  {0}  (34) 

satisfies  the  following  conditions: 

(1)  Each  member  r  of  A|7  Is  a  subset  of  J  and  contains  at  most  one  point  in 

{i . N\t(k  )}x{Jk }  for  each  k£ K. 

(2)  Any  two  sets  belonging  to  A|J  do  not  Intersect.. 


For  each  measurment  Index  set  J ,  define 


T(J)  —  {tCJ  |  #  (t|  Jt)<l} 


and 


HU) 


f  j  ri  flr,=0  for  any 

|^CT(y)\{0}  |(ri>T2)GXXX  such  that  r,^r2 


(35) 


(36) 


In  (35)  and  other  subsequent  equations,  we  use  the  notation 

t\Ic  =  t  n  ({1 . NM(k)}x{k}) 

for  any  set  r.  We  call  any  element  In  T (J)  a  track  on  J  and  any  element  In  HU) 
a  hypothesis  on  J .  According  to  these  definitions,  for  any  measurement  Index  set 
J .  A|J  Is  In  H(J)  and  each  element  In  A|7  Is  In  TU). 

3.2  Information  Fusion  Problems  The  distributed  estimation  problem  In  this 
multi-target  tracking  environment  Is  to  obtain  (in  a  distributed  way) 
Prob  {  A|J(,)  |  Z"1}  for  each  Information  node  i  In  I  where  J(,)  Is  defined  as 

J{i]=  {(>  .fc  )eJ  |  keK(i)}  (37) 


This  problem  actually  consists  of  two  problems: 

(1)  (Hypothesis  Formation)  Suppose  i0  Is  a  communication  receiving  node  and 
J  Is  the  set  of  its  Immediate  predecessor  information  nodes.  If  every  node  « 
In  I  contains  all  the  set.  of  tracks  and  hypotheses  on  J1",  how  can  we  con¬ 
struct  T(U/(”)  and  H(U/”)  ? 

id  id 

(2)  (Hypothesis  Evaluation)  Suppose  the  above  sets  of  tracks  and  hypotheses 
are  generated.  How  can  we  evaluate  each  hypothesis  using  the  evaluation 
made  by  the  predecessor  nodes  ? 
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We  will  discuss  these  problems  separately  In  the  following: 

Hypothesis  Formation:  For  each  track  r  In  T(J),  each  hypothesis  X  In  H(J) 
and  each  J  CJ.  we  define  the  restriction  of  r  on  J  and  the  restriction  of  X  on  J 
by  rDJ  and 

X|J  =  {rDJ  I  rex}  \  {0}  .  (38) 


respectively.  Each  of  these  restriction  operations  defines  a  partial  order  on  T(J) 
or  H(J)  which  Is  arborescent  (tree-like  —  for  each  element,  the  set  of  Its  predeces¬ 
sors  Is  totally  ordered).  Moreover,  the  restriction  operations  are  commutative 
with  the  Intersection  operation  in  the  sense  that  (rH  •/,)(") J-2—rO(J ,D  J3)  and 

(X|/,)|  J.,  *=  X|(J,n/2)  (39) 

for  any  measurement  Index  sets,  J,  and  J2.  (39)  Is  not  quite  obvious  but  can  be 
easily  proved. 

Let  be  an  arbitrary  tuple  of  measurement  index  sets  where  /  Is  an 

arbitrary  nonempty  set.  Then  we  call  any  tuple  (r,),€/  of  tracks  In  FlTf/,)  fus- 

id 

able  If  there  exists  a  track  r  In  T(U*f,  )  such  that 

•  e/ 

rfV,  =  r,  (40) 


for  ail  »'€/-  Similarly  we  cal!  any  tuple  (X,  )l€/  of  hypotheses  In  IlH(J,)  / usable  if 

i  C.I 

there  exists  a  hypothesis  X  in  H( U  Ji )  such  that 

iCl 

XI  Ji  =  x,  (41) 


for  all  «6/.  The  following  lemma  gives  a  sufficient  and  necessary  condition  for 
each  of  the  above  fusabillty  definitions: 

Lemma  5:  Let  ( J,),( /  be  an  arbitrary  tuple  of  measurement  index  sets. 
Then  ire.  hare 

(1)  Any  track  tuple  in  i  |T(./,  )  is  J usable  if  and  only  if 
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(«) 


r,  nu.pj.j  -  T,pnj,  nj,) 

for  all  (« X  / 

(2)  Any  hypothesis  tuple  (X,  )lC/  in  I  JH(  J, )  is  fusable  if  and  only  if 

■6/ 

x,,l  u,,ru2)  -  x.ju,  nyj  (43) 

for  all  X I . 

Proof:  (1)  and  (2)  state  that  a  tuple  of  tracks  (or  hypotheses)  Is  fusable  If  and 
only  If  they  share  the  common  predecessors  In  the  overlapping  measurement 
Index  set.  l.e., 

J  ~  UU.rU  J  (!,..••,)€/ X/  such  that  i,y^i-2}  (44) 

In  (1)  and  (2),  the  "only  If  parts  are  obvious.  To  prove  the  "If’  part  of  (1), 
let  r—Ur,  and  J  —  U./,.  Since  every  r  is  a  subset  of  J  ,  rCJ.  Let  K  be  the 

i €/  »€/ 

index  set  uniquely  determined  by  J.  Suppose  there  exists  a  Jt  In  K  such  that 

#  (r|  Jfc)>l.  Then,  since  1  <  #  (r  |  k )  <  S#  (r,  |  k )  and  since  each  r,  Is  a  track 

«'€/ 

on  Jit  there  exists  such  that  #  (rt-t  |  Jfc  )=#  (r,  |  k  )—l  and  r.  ^r,  .  In 

other  words,  rt)  and  r,a  do  not  share  a  common  predecessor  on 

{l . Nnt}x{k}C.J,  C\J,  ,  which  contradicts  with  the  assumption.  Therefore,  we 

must  have  #  (r  |  k  )<  l  for  all  k  in  K ,  implying  t£T(  J). 

Since  every  r,  is  Included  In  r  and  in  Jt ,  we  have  r,  CrflJ,  for  every  »  In  /. 
Suppose  there  exists  an  i  in  /  such  that  r.CrDJ,,  l.e.,  there  exists  (>  .it  iGrO./, 
such  that  (;,Jt)gr,.  Then,  since  (j'.it)  Is  In  r,  there  must  be  « '  in  /  such  that 

ij^i'  and  ( j  ,k  )Gv>  which  Implies  that  7,  and  r,.  do  not  share  a  common  prede¬ 
cessor  on  {l . NM{k)}x{k}  and  contradicts  the  assumption.  We  must  have 

tC]J,  -  r,  for  all  *  In  /,  l.e.,  (r,  )l£/  is  fusable. 
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To  prove  the  "If  part  of  (2),  we  assume  #i/}==2.  For  we  can 

prove  It  similarly  but  need  much  more  complicated  notations  and  space.  Suppose 
( X,  ,X,  )6H(7,,)XH( )  and  (431  holds  with  /  ={«',. i2}.  Let  X  be  the  common 
predecessor  on  J Pi/- ...  Then,  as  shown  In  Lemma  1  of  Appendix  C  of  flj.  For 

each  TEX  and  for  each  «  in  /,  there  exits  a  unique  track  r,  (7)  which  Is  an  exten¬ 

sion  of  7,  i.e.,  t,  (7)l~)  J  ~7.  Let 

X  {U  r,(r)|rEX}  U  (U(>s\(U  LCO))) 

■  6/  ■€/  Tex 

Then  every  r  in  X  is  a  track  on  J  and  any  two  tracks  in  X  do  not  Intersect. 

Moreover,  for  every  track  r  in  X,  we  have  either  rfl^,  =r,  (rfl-/)  or  rn/,  =0.  i.e., 

X|J,  —  X,  for  all  «  in  /.  Hence  the  hypothesis  pair  (X.  .X,  )  is  fusable.  When 

#(/)> 2,  we  must  construct  hypotheses  similarly  but  we  must  start  with  the 

common  predecessor  tracks  in  P) J,  and  repeat  the  process  for  all  the  Intersec¬ 
ts 

lions  with  gradually  fewer  terms.  Q.E.D. 


Remark:  Since  J  CJ  Implies  rfV€TV)  for  any  track  tET(J),  the  restriction 

operation  (40)  defined  a  mapping  from  T(U«/,)  to  nT(J,  ).  The  definition  of  the 

«€/  *€/ 

fusabillty  implies  that  the  range  of  this  mapping  is  exactly  the  set  of  all  the  fus¬ 
able  tuples  of  tracks.  Suopose  tET(U"/,)  and  rfl^,  =r,  for  all  t  In  /.  Then, 

»€/ 

Ur,  ~  U(rH  J, )  —  rD ( U  ■/, ! ~ r.  Therefore,  the  unionization  operation  Is  indeed 

id  >a  i  €/ 

the  Inverse  mapping,  and  hence,  the  set  of  all  the  tracks  on  U .  i.e.,  T! U -4  )•  ts 

«€f  id 

Isomorphic  to  the  set  of  all  the  fusable  tuples  of  tracks.  Similarly  ,/C.T  implies 

(X  1  J)£H(J)  for  any  hypothesis  XeH(U./,)-  Therefore  the  restriction  operation 

id 

(41)  defines  a  surjective  mapping  from  H(U>/,)  to  the  set  of  all  the  fusable 

id 

hypothesis  tuples.  This  mapping,  however,  may  not  be  bljective  (one-to-one).  A 
counterexample  was  given  In  ll]. 

Lemma  5  provides  us  with  ways  of  generating  T( U  J, )  and  H(LM  1  from 

id  >d 

II  T(  J,  )  and  nm/, ).  respectively.  However,  checking  the  conditions  described 

i(i  i(i 
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by  (42)  or  (43)  may  not  be  directly  conducted  on  the  Information  nodes  which 
precedes  1.  Nonetheless,  by  applying  Lemma  2  In  Section  1,  we  can  transform 
(42)  and  (43)  into  a  form  by  which  predecessor-consistency  tests  are  required  only 
on  certain  predecessor  nodes  of  7.  The  result  Is  stated  as  follows: 


Theorem  4-  Let  be  a  communication  receiving  node  and  I  be  the  set  of 
all  the  immediate  predecessors  of  it.  For  each  («|,»2)€/  X/,  let  /(«',. t2)  be  a  set  of 
information  nodes  i  such  that  «  <»,  and  i  <t2.  Then,  we  have 

(1)  a  necessary  and  sufficient  condition  for  any  track  tuple  (r,  )ie/€llT(  J" ')  to  be 

•  €/ 

fusable  is  that,  for  any  (t  ,.«2)€/  X/, 

r(irV,r’ =  r,8rV(r'  (45) 


for  any  «  €/(«,.«’2),  and 

(2)  a  necessary  condition  for  any  hypothesis  tuple  (X,  )l6/ GllH(  J{' ')  to  be  fusable 

•  el 

is  that,  for  any  (t  ,,»8)€/  Xl , 

X„  |  /(7)  =  X(  j  |  J<* '  (40) 


for  any  »G/(t'f,i2l. 

Proof :  Suppose  («',.«2)e/X7.  Then,  by  Lemma  2  of  Section  1,  we  have 

U  j{7)  =  yl,,>n/,s’.  (47) 


Therefore.  If  (45)  holds  for  all  i  In  /(*  |.*2),  (42)  holds.  Conversely,  for  any  •  in 
7(it.i.2),  J"  ,Cy(,,1Dy(’,),  and  hence,  (42)  Implies  (45)  and  (43)  Implies  (40).  Q-E.D. 


Remarks: 

(1)  For  each  (»,.«2)G/  X/  such  that  i,^i2t  a  set  /(«',. i2)  of  common  predecessors 
I  such  that  i ’<«,  and  r<i2  may  not  be  unique.  When  the  above  theorem  Is  used 
to  test  ftis, ability,  any  Information  node  7  In  /(i'I.»2)  such  that  t  -  7’  with  another 
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«  '  in  / can  be  excluded  from  /(»,,ia). 

(2)  The  type  of  tests  defined  by  (45)  or  (46)  provides  a  necessary  and  sufficient 
condition  for  track  fusablllty  but  only  a  necessary  condition  for  hypothesis  f usa¬ 
bility.  This  is  due  to  the  fact  that  a  fusable  tuple  of  tracks  produces  only  one 
fused  track  but  a  fusable  tuple  of  hypotheses  may  produce  more  than  one 
hypotheses.  Thus,  (47)  is  not  a  sufficient  condition  for  the  hypothesis  fusability 
as  shown  below: 

Counterexample: 


This  is  an  example  of  broadcasting  type  communication  and  we  have 


J  '  —J{  “  —  J1  ’U-/"''  —J 1,1  ’D y"s>.  Let  ( X,.Xa)  be  an  arbitrary  pair  or  hypotheses 
on  and  Ju‘\  respectively,  to  be  fused.  They  may  share  identical  predecessors 
X7eH(j"7')  and  X„6H(y""')  while  predecessor  Xft  on  y"1'  of  X,  may  differs  from  the 


predecessor  Xfl  on  of  X2.  In  such  a  case,  X,  and  Xa  cannot  be  fused. 


Hy  the  fact  stated  in  (2)  of  the  above  remarks,  we  cannot  determine  the 
rusablllty  of  hypothesis  tuples  by  this  theorem.  However,  part  (1)  of  this  theorem 
can  be  used  Indirectly  to  determine  the  fusablllty  of  hypothesis  tuples  according 
to  the  theorem  stated  below.  On  the  other  hand,  the  above  theorem  ran  be  used 
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to  screen  hypothesis  tuples  for  candidates  to  be  fused. 


Theorem  5:  Let  ( y,),e/  be  any  tuple  of  measurement  index  sets  and 

J  —  U-A-  Then,  for  any  given  XCT(J)\  {0}  and  any  given  (X, ), e / G FI H( J,  ),  we 
.e/  i ei 

have  XfEHU'i  and  X  |  J,  =Xt  for  all  t  in  I  if  and  only  if 

(1)  for  any  r  in  X,  there  exists  a  fusable  track  tuple  (r,  ),6/ GlKX,  U  {0})  such  that 

*'e/ 

r—  U  r, ,  and 

iei 

(2)  for  all  i£l  and  and  for  all  t,  £X, ,  there  exists  a  unique  r  in  X  such  that  r,  Cr. 


Proof:  [if]  Assume  (1}  and  (2)  hold  for  given  XCT(7)\{0}  and  (X,  ),e/GnH(y, ). 

<  G  / 

To  show  X£H(J)  it  suffices  to  show  X  does  not  have  any  overlapping  tracks.  Sup¬ 
pose  there  are  overlapping  tracks  r,  and  r2  in  X,  l.e.,  (r,,r:,)gXxX,  T\~^r>  and 
r,nr27^0.  Then  by  (l).  for  each  /G{l,2}  there  exists  a  fusable  track  tuple 
(ru  l.e/^rilX,  U{0})  such  that  r;=(Jr/,-  Since  there  exists  a 

i €/  *€/ 

(«i.ta)€/X/  such  that  r„  nraij^0.  For  each  /€{l.2},  r(l(€X,-  because  r(l  7^0.  Since 
X,(GH(JI()  for  each  /,  «,=«2  implies  rl(l=r2tj.  If  we  have  rh  Cr,  and  r„ Cr2,  the 
uniqueness  part  of  (2)  is  violated.  Therefore,  we  must  have  i,t^i2.  On  the  other 
hand,  the  fusabillty  assumption  in  (I)  Implies  ^,=7(0/,  for  each  (/,»  )6{l,2}x/. 
Hence  we  have 


0  ^  r  I . ,  n  T2 ,  —  ( r ,  n  J,  ( )  n  ( r2  n  /,  )  c  r2  n t  n  j, . — ,  n  y,  C  r. . . 


which  means  r,,-  O r.lx  ^<h.  Also  the  uniqueness  part  of  (2)  prohibits  r„  =rSli. 
This  contradicts  with  X.  ^Hfy,  ),  r^EX,^  and  rs,  GX,^,  Therefore.  X  must  be  a 
hypothesis  on  J ,  or  X£H(y  ). 


I,et  »£/.  Suppose  r,GX(.  There  exists  a  r£X  such  that  r,  Cr  by  (2).  Then, 
by  (I).  there  exists  a  fusable  track  tuple  (/,,),>£/ EllfX, 'U{0}1  such  that  r  U 

i'C-f  i\  I 

Then,  for  each  t,  the  fusabillty  Implies  ^/-r^QrDJ,  f.  Since  \,tT !!(./,  ),  we 
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must  have  r',  r, .  I.e..  r,tX[y,.  On  the  other  hand.  If  r,  GX]./, ,  i.e.,  If  rt  ytH  and 
tDJ,  t,,  (I  I  and  (2)  similarly  Imply  r,  gX,  .  Hence  we  have  X|J,  -----  X, . 

[only  if]  Suppose  XGH(/)  and  X|J,  ^X,  for  all  iG/.  For  all  r£X  and  for  all 
»’€/.  let.  r,  rH7t.  Then,  (r,  )lt/  apparently  satisfies  the  requirements  of  (1).  (2) 
follows  directly  from  X| ./,  ~X, .  X  is  a  hypothesis  on  J,  and  hence,  does  not  have 
any  overlapping  tracks.  This  proves  the  uniqueness  part.  Q.E.D 


Remark:  From  the  proof  it  Is  clear  that  the  condition,  r,  Cr  in  (2)  of  Theorem  5 
can  be  replaced  by  r,  —  rfl  J, . 


Hypothesis  Evaluation:  In  addition  to  Assumptions  [Al]  -  [A8],  [Cl]  -  [C3j 
and  the  assumptions  made  earlier  In  Section  3.2,  we  have  to  add  the  following: 


[El]  (Poisson-!. i.d.  Targets)  The  number  Nr  of  targets  Is  constant  over  time 
and  has  a  Poisson  distribution  with  mean  i/o>0.  Given  A’r  >0,  [x ,(<  is 
a  system  of  Independent  Markov  processes  sharing  the  identical  joint  distri¬ 
butions.  Moreover,  each  process  is  bi-directionally  deterministic  having  an 
identical  group  of  deterministic  state  transitions  and  an  identi¬ 

cal  Initial  state  distribution  which  has  density  qt  (z (<„)). 


[E2]  (Independent  Detection)  For  each  k=(s,t)£ K,  we  have1 


Prok  (Dom  (A  tk  ))  |  (x,  (t  )),_!,,  Af  7-  ) 


•18) 


n  p„  i z.-  ( n  [  * )" ' :Dem iA{k  ( i -p0  (*,- ( n  | 


\(  i  iDom  •  ,1  •  k  | ) ! ‘ 


[E3]  (Random  Assignment)  For  any  k  GK,  given  Nsi(k)  and  Dom  (A  (k )),  every 
realization  of  A  [k  )  Is  equally  probable. 

[H4]  (False  Alarm  Number)  For  each  k  (s  ,t  )£K,  we  have 


I  l'»r  :m>  riilirtlon  /  \E  ~*F  .  l)om  (  /  )  I-  ll-  <lom:i|n  ami  lm  (  /  >1-11-  \( )  h  tin-  linlli-.i- 

t or  fmiillmi  of  -el  h  .  \  r  \(c  ,1:  )  I  -  I  If  eQh  0  <n ln  r« l-r. 
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Prob  ( N\f  ( k  )\A(k  ).(x,(t  ))*It,NT  )  =  pNf  4  ( ATW  ( k  )  -  #  (/m  {A  (k  )))  \  k  )  (-19) 

[E5j  (Independent  Measurement)  For  each  )EK  and 

:k  E2 ,  we  have 

Prob  ((yj  (t  ))*",'*  6(rfy;  ’ !  A  (k),NM  ( k  ).(x,  ),NJx,Nt  )  =  (50) 

(  n  PA/(yA(.)l  xi(t))tijdyAi{ ,))•(  n  p™  (y;  I  *K(y/)) 

■  enomi.t  i  jeJFAik) 

where 

4vi(*>  =  {« . Arw(*)}\/m(>4(*))  (51) 


For  any  track  t£T(J)  and  any  Information  set  Z  with  index  set  K  and 
measurement  index  set  J ,  define  track  likelihood  of  track  r  given  Z  by 

l(T,Z)  —  i/„  c  (r.Z)  (52) 

where 

c  (r  Z  '■  —  f(  El.  9  (y  (r  j  k)  j  «ht.  _ti(x),k))  <?,  (!  )//(rfx)  .  (53) 

k  €  A 

with  Z  (k  ))^y,k  \.\M(k  ).sk  ,<*  )  |  EK  }, 


/y,(*>  ir(>.Jt)--(r|  A  )  Jf--  0 

\0  otherwise 


(s-0 


and 
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fPu(y  i  x.k )  pd(x  |  k ) 

9(!,|''*,'s  i i-p/,(i  !  *) 


if  y^o 

otherwise 


(55) 


For  any  t  f_  T ,  let  the  measure  ot  on  A'  be  defined  by 

ot(E)~  f  qtJ,x)p(dx ) 

(  +  ,  ,  I  \K) 


(56) 


and  let  qt  (•)  be  the  density  of  <x,  with  respect  to  p.  Then  we  have  the  following 
theorem: 


Theorem  6:  Let  Z  be  any  information  set,  and  let  K  and  J  be  the 
corresponding  index  set  and  measurement  index  set.  Then  we  have 

(1) 


Prob  (a\J  j  Z)  =  P(Z)  '  exp  (t  (0.Z  )~v„) 


(57) 


where  NFa  (k  )=NM(k  )  -  #  (  U  r  |  k  ). 

(2) 

idK  )  4  E (Nt~#  (A|J)  |  \\J.K  )  —  l(t».Z) 


(3)  For  any  t  £  T  , 

Prob  {(x,(<  ))tNJ,&dXi  ),NIl  j  U.NT  ,\\J  ,z}  — 


(  n  P,  (I,1|r,  I  t,Z  )(itdxll{l ,))(  n  P,(X,  I  <h.Z)n(dx,)) 

rf  \\J  I  p/m  II 11 


(58) 


(59) 


where  U:.\\J—Ir  is  one  of  the  equally  probable  1-to-l  assignment  functions  from 
tracks  to  target  indices,  and 
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(60) 


p,  (X  I  T,Z)  =  C  ( T.Z  ) 


(  n  ff(y  \r  |  *]  I  <*»,,  (X  ).k  ))  q,{  X) 

ktk 


Proof:  Suppose  K  Is  ordered  arbitrarily  as  K  —  {kl.k.J . km  }  such  that  tk  ,<**,• 

Then,  according  to  Corollary  to  Theorem  2  In  Section  5  or  [2],  we  have  (57)  with 

l  (r.Z  )  =  i/„  fl  J g(y  ir  |  k,  j  |  x  ,kl)pu  (z  |  rr\Ji-i.Zi„,)fi(dz  )  (61) 

t  =l*r  » 

where  J,  =,{(  j  .k,.)£J  !  «'<* }  and  Z,={(q.kt.)eZ  \  <'<*}■  By  means  of  mathemati¬ 
cal  induction,  we  can  show 

FI  fs(y[»’i  hi]  |  x.kpipt  (x  !  rriJ,.l.Z1_1)M«^)  (°2) 

»=1 J  » 

=  /  fit  (fir  I  till  *tt  -tJl*)'ki)qtJl*)rtdx) 

=  /  n»(»!*-|  *,•]  |  d>,k_t(x).k,)qt(x)p(dx) 

Thus  Part  (1)  follows  from  (52)  -  (58)  and  (61)  -  (62). 

According  to  Part  [li]  of  Theorem  2  in  Section  5  of  [2],  with  the  same  order¬ 
ing  of  K  as  above,  we  have 

uk  —  uk  ,  J g (0  I  z  ,kj  )pfi  ( x  I  <h.Zi^)fi(dx  )  .  (63) 


By  repeatedly  applying  (63),  we  obtain  Part  (2).  Part  (3)  then  follows  from 
Lemma  2  and  Part  [1]  of  Theorem  2  of  Section  5  in  [2).  Q.E.D. 

The  distributed  version  of  this  theorem  follows: 

Theorem  7:  Let  ia--(t  ,n  ,CR  )  be  a  communication  receiving  node  in  I CK 

and  I  be  the  set  of  all  the  immediate  predecessors  of  i„.  Let  Z  —  UZ,'>  with  K 

i  c  i 

and  J  be  the  associating  index  set  and  measurement  index  set.  Let  (T, a)  be  the 
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pair  which  satisfies  the  conditions  (2-1)  and  (25)  of  Theorem  S.  Then  we  have 

(1) 


Prob  (A|7  \Z)  =  d  FI  Prob  (AV'7')  l  Z'T,r,7>  W  (r,(Z'7')TeT) 
TeT  f€.y 

where 

d  ~  P  (Z )  1  (n  P(Z,7,rt7’)  cxp(iiK)-  'Ea(iMK{7>))  . 
TeT  TeT 


(64) 


(65) 


T(r.(Z(7')7eJ)  =  (n^Ar,r,)Gr(T)a(,))  c  {r.(Z{7))TeT) 
ieT 


(66) 


\\  irrny‘r,=0 

W  =  |o  otherwise  ’  (67> 

and 


c  (r,(Zt7,)reT)  =  f  nPl(x  |  (r nJt7,).Z(7'y"7Wdz)  ,  (68) 


(2) 

pt(x  \t.Z)—  7 (r.(Z,r,)r€r)  ‘  n  pt(x  I  (rny,r,),Z(7,)0<r)  ,  (69) 

«€/ 


and 

(3) 

iak)  =  T mz(7))T€T)  =  (n  tdK,7,)n(7')  f nPt(x  i  ix7Yi7)p«ix)  (70) 

^  TeT  *  7cT 


Proof:  Let  (l  .a)  be  the  pair  which  satisfies  the  conditions  (24)  and  (25).  Then  we 
should  first  note  that,  by  Lemma  S  and  Theorems  1  and  2,  we  have 
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(71) 


a\K\  A  n«j 

k(K 


n(  II  »,) 

■  ef  *<?*'*’ 


<.c  i 


n  11.(0, ) 

■  ef  kcK‘" 


*<•  i 


for  any  (ak)keK  such  that  ak  >()  for  all  k£K.  Also,  as  shown  In  the  proof  of 
Theorem  1,  If  ak  Is  constant,  i.e.,  if  ak  -a  for  all  k£K,  we  have  a\K\  —  a.  For 
notatlonal  simplicity,  we  abrevlate  notations  as  gk  (z  ,r)  =  g  (y  [r  |  It  ]  |  <*>(.  _t  (x  ).k  ) 
and 


If* 


NFA(ky. 

Nulky. 


PNf<(^FA  (k)\k)  FI  pFA  (Vj  (k  )  |  k  ) 

jeJfA(k) 


Then,  It  follows  from  Part  (1)  of  Theorem  6  that 


IT  Prob(\\JU)\  Zt,]) 
TeT 


(72) 


n(p(zJri  cMk9.z^)~u0)  (  n ./(*■, z<7>))} 

'€/  rOP'" 


«(i  ) 


=  cxp(Ea(«  )/(0.Z,r'))  cxp(-t/0) 

TeT  TeT 

(n  nj//vr,)(n  n _/(r.z<r>>) 

■  ef  keK"'  (ef  rt.v/"1 


It  follows  from  (71)  that 


njr  -  n  nMAy,{" 

keK  >eT  k eKu> 


(73) 


and 


(  II  9k  (*  •r))?(  (x  )  —  n  n  _(?*  (x  J)q,  [x ))"“  ’ 

tgA  »ef  * eci" ’ 


(74) 


On  the  other  hand.  It  follows  from  (00)  that 


mx  i  c(rn/(”.z"V',("  n  (Mx.rn./'r,)Mx)) .  (75) 

keK"' 


for  each  ie7.  Then  It  follows  from  (52),  (53),  (74)  and  (75)  that 
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l(T.Z) 


(W(Tnj{T,.z'Tv:')(fiift(z  i Tr)f''.z'TYT'n(d*)) 


(76) 


Part  (l)  then  follows  from  (72),  (73)  and  (76).  Parts  (2)  and  (3)  cab  be  proved 
similarly.  Q.E.D. 


Remark:  By  the  definition  of  l  by  (66)  -  (67),  we  can  Interpret  /  as  track-to- 
track  likelihood  of  the  tuple  (tDJ*'  of  tracks.  This  likelihood  can  also  be 
defined  as 


l  (r.(2,rV6r)  =  /n  pt(x  j  (rCU^'U^'Y^Wx) 


(77) 


where 


' t(z  |  (TnJ{7\Z{T])  =  p((x  |  (rn/(r)).Z,ri)  (78) 


4.  Conclusion 


Solutions  were  given  to  distributed  estimation  problems  and  to  distributed 
multitarget  tracking  problems  with  arbitrary  communication  patterns  defined  by 
Information  graphs  In  bl-dlrectlonally  dltermlnistlc  cases.  It  Is  expected  that  the 
results  described  In  this  appendix  provide  sufficiently  functioning  distributed 
algorithms  even  without  the  bi-directional  determinancy  if  the  randomness  in 
state  transition  Is  small  and  the  communication  Is  reasonably  frequent. 
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